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Cranks and f-cores 


Frank Garvan,' Dongsu Kim,” and Dennis Stanton* 


’ School of Mathematics, Physics, Computing and Electronics, Macquarie University, Sydney, 
NSW 2109, Australia. 
2 School of Mathematics, University of Minnesota, Minneapolis, MN 55455, USA 


Summary. New statistics on partitions (called cranks) are defined which com- 
binatorially prove Ramanujan’s congruences for the partition function modulo 5, 
7, 11, and 25. Explicit bijections are given for the equinumerous crank classes. The 
cranks are closely related to the t-core of a partition. Using q-series, some explicit 
formulas are given for the number of partitions which are t-cores. Some related 
questions for self-conjugate and distinct partitions are discussed. 


1. Introduction 


Let p(n) be the number of partitions of n [1]. Dyson [7] proposed a combinatorial 
proof of Ramanujan’s congruence 


p(Sn+4)=0 modS. 


He defined an integral statistic on partitions, called the rank, whose value mod 5 
split the set of partitions of 5n + 4 into 5 equal classes. He further conjectured that 
the rank also proved 


p(7n+5)=0 mod7, 
and hypothesized a statistic, called the crank, which would similarly prove 
p(lin+6)=0 mod11. 


Atkin and Swinnerton-Dyer [5] proved Dyson’s conjecture for 5 and 7. In [9], a 
crank for 11 as well as new cranks for 5 and 7 were found relative to vector 
partitions. Later, Andrews and Garvan [3] were able to define a crank, in terms of 
ordinary partitions, for 5, 7 and 11, thus completing the solution of Dyson’s crank 
conjecture. New relations for the crank of partitions mod 8, 9 and 10 have been 
found in [10]. 


* This work was partially supported by NSF grant DMS: 8700995 
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Explicit bijections between these equinumerous classes have not been found in 
any of these three cases. This should be related to another possible approach to 
these problems: split the set of partitions of 5n + 4 into p(5n.+ 4)/5 classes, each of 
size 5. Hopefully, the bijections among the five classes should be realized by a 5- 
cycle which acts on all partitions of 5n + 4 with no fixed points. The orbits of the 5- 
cycle are the p(5n + 4)/5 classes. A crank statistic should be defined which is 
{0, 1, 2, 3, 4} on an orbit. A 5-cycle, but no crank, was found by computer in [11]. 
In this paper, we complete this program by finding dihedral groups of size 10, 14, 
and 22 which act on the partitions of 5n + 4, 7n + 5, and 11n + 6, respectively. The 
5 (7 or 11) cycles in these groups have no fixed points, thus proving the con- 
gruences. We also define new statistics on partitions, i.e. new cranks, which split the 
set of partitions into equinumerous classes. A cycle in the dihedral groups increases 
the crank by 1, thus supplying an explicit bijection between the crank classes. Our 
definitions of the cycles and the cranks are completely combinatorial. 

The key ingredients to our proof are two bijections for partitions and t-cores, 
which are given in §2. They allow us to find dihedral groups as symmetry groups of 
quadratic forms. There are interesting q-series attached to these forms, and these q- 
series imply some remarkable explicit formulas (Theorems 4 and 5 in §5) for the 
number of partitions which are t-cores, t = 5 or 7. The explicit cranks are given in 
Theorems 2 and 3, and in Proposition 1 of §3 and §4. A crank for 25n + 24 is given 
in §6. Similar bijections and generating functions for self-conjugate partitions and 
partitions with distinct parts are given in §7 and §8. 

We shall use the notation for generating functions from q-series, e.g. 


k-1 ‘ 
(asd = [] —aq'), 


1 


OO aalied “oe 


2. Two bijections 


In this section we give two bijections relating partitions and t-cores. 

First we set the notation. Let P be the set of all partitions. For any A€ P, let | A| 
denote the number that A partitions. Fix a positive integer t. Let P, _ ..,. be the set of 
partitions which are t-cores. Recall that there are two equivalent definitions of a t- 
core: a partition / is a t-core if, and only if, 2 has no hook numbers that are 
multiples of t [13, 2.7.40]; or if, and only if, A has no rim hooks that are multiples of 
t (13, p. 75]. We let a,(n) be the number of partitions of n which are t-cores. 

The first bijection is well-known [13, 2.7.17]. 


Bijection 1. There is a bijection @,: P > P,_.9. X Px Px... x P, 
$,(A) ys (, ho, A, sey A, -1) ’ 
such that |A| = |A| + tY 42} |Ajl. 
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The generating function identity pets to Bijection 1 is 


MY a,(n)q” . 


y p(n)q" = 
n=0 


(q'sq'\. 7 


The second bijection is on t-cores only. 


Bijection 2. There is a bijection 6: P,—core—> {n =(Mo,M,---, 
No +... +n,—, = 0}, where 


|A| =t\n|/2/2+5-n, b=(,1,...,t—1). 


The generating function identity equivalent to Bijection 2 is 


a,(n)q" = bs qiin! +b-n 


Clearly (2.1) and (2.2) imply 


(2.3) 


n 


We now give Bijection 2, and sketch Bijection 1. 

Let A be a t-core. Define the vector n= (A) i in the following way. Label a cell 
in the ith row and jth column of A by j —imodt. (This is called the t-residue 
diagram in [13, p. 84].) We also label the cells in column 0 in the same way, and call 
the resulting diagram the extended t-residue diagram. A cell is called exposed if it is 
at the end of a row. Region r of the extended t-residue diagram of / is the set of cells 
(i, j) satisfying t(r — 1) <j — i < tr. We now define n; to be the maximum region of 
4 which contains an exposed cell labeled i. Since column 0 contains infinitely many 
exposed cells, n; is well-defined. 

If an exposed cell labeled i lies in region r, then there is an exposed cell labeled i 
in each region <r. For example, in region r — 1, if i is not exposed, then the rim 
hook whose northeast head is i in region r, and whose tail is i + 1 in region r — 1 
has length t. (Note: If i= — 1, the rim hook will lie entirely in region r.) This 
contradicts the assumption that 4 is a t-core. 

Note that the size of the Durfee square of 7 is the sum of the positive n,’s, since 
this is the number of exposed cells in positive regions. 

We next verify that no +n, +... +n,-,=0. Let 2’ be the conjugate 
of 4. First we show that if 3(A)=(mo,m,,...,m,-1), then 9$,(2’)= 
(—n,-1, —M,-2,°*~, —Mo). Let a cell labeled i be exposed in region r of A, so that 
i+ 1 lies above i. In 1’, the cell corresponding to i + 1 will be labeled t — i — 1, lie 
in region 1 — r, and not be the last cell in its row. Thus t — i — 1 is not exposed 
in region 1 — r of 2’. This shows that if i is exposed in region r of 4, r <n;; then 
t — 1 — iis not exposed in region r of 2’,r = 1 — n;. A similar argument shows that 
if a boundary cell labeled t — i — 1 is not exposed in region 1 — r, then i is exposed 
in region r. This verifies the claim about #,(/’). Since the size of the Durfee square is 
unchanged by conjugation, the sum of the positive n,’s must be equal to minus the 
sum of the negative n;’s; that is, npg +n, +... +n,_, =0. 
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The inverse map to @, is easy to find: if (no, n,,...,,-,) is given, then the 
exposed cells in each region are known. This in turn gives the lengths of each row of 
the Ferrers diagram of 4, and thus i. 4 

Finally we show that if $2(A) = =n, then / is a partition of the exponent in 
Bijection 2. The number of cells to the right of the main diagonal of the Ferrers 


diagram of / is 
Nn: 
in, +t{ ~ ). 
a in; + (") 


For the cells below the main diagonal, we take 2; to find 
; — Nj 
— Fe = 1s +( a 
nj< 0 ye 


y 1; 
nzu>oO 


There are 


cells on the main diagonal. The sum of these three terms is the exponent of q in (2.3). 

We quickly sketch ¢, using the notation in Bijection 2. Given A, we construct t 
biinfinite words in the letters N and E, wo, .. . , w,—-,. The jth letter of w,; is E ifi is 
exposed in region j of A, otherwise the jth letter is N (not exposed). If A is a t-core, 
then each word w, is an infinite sequence of E’s followed by an infinite sequence of 
N’s. In this case, A = A, and A; = @ for all i. Otherwise there is an E to the right of 
some N. Find the rightmost E, say in position j. Find the rightmost N to the left of 
this E, say in position k < j. Delete a rim hook in 4 whose northeast head is the cell 
corresponding to E, and whose southwest tail is adjacent to the cell corresponding 
to N. Place a part of size j — k in A;. The new partition has N’s in w; from position j 
on, thus the E’s have been pushed to the left. This operation can be done in any 
order whatsoever, to finally obtain the t-core of A, 4. The parts of each J; appear in 
increasing order. 


3. Cranks 


In this section we give the cranks (Theorem 2) and the cycles which give bijections 
for these crank classes. 

Let r be a residue class of t, and consider p(tn + r). On the right side of (2. 3), all 
exponents of q which are equivalent to r mod t lie in the multisum. Since n- 1 = 0, 
we have §||n||? = 0 mod t. Thus we have 


fe 6) 1 a 7 
 eaaaellilier 5 gli +B 3.1) 
v 91 10 j- dt 


=rmo 
AL 0 
eZ' 
The symmetry groups of the quadratic ammo in (3.1) have been computed by 
computer for t < 8 in [11]. Until now, we have assumed that the class t and residue 
r are arbitrary. We shall see that the choices of 5n + 4, 7n + 5, and 11n + 6 simplify 


(3.1). 
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For 5n + 4 we now change variables so that the symmetry group is obviously 
the dihedral group D, of order 10. The five vectors n for ¢,(p(4)) are 


(1) B =(1, —1, 0, 0, 0) 
(2) 3, =, 1, -1,0, 0), 
(3) 8, = 0, 0, 1, 1, 0), 
(4) 3; =(0, 0, 0, 1, —1), and 
(5) &, =(1, 1,0, —1, —1). 


They form a non-planar pentagon whose center ¢ = (2/5, 1/5, 0, —1/5, —2/5). 
We now change variables: write N= Apo +... + &40,4. A vector nEZ? satis- 
fies n-1 = 0 and b-i = 4 mod5S if, and only if, n = aov9 + ... + a40,4 for some 
aeZ°> such that z-1 = 1. 
It is easy to see that the quadratic form in (3.1) in terms of the vector « is 


> 


Sal]? — S(aot, + at, +... +tigte)—1. 


Thus we obtain 
, aston +4q*'= > q O(a) 
weer" 
where Q(a) = ||a||? — (apa, + 1%, + ... + 409). Clearly the dihedral group D, 
is the automorphism group. 

It is also clear that the 5-cycle which cyclically permutes the «;’s has no fixed 
points. Any fixed point « must have all entries equal. Since a: 1 = 1, this would 
imply that the entries are not integral. 

The construction of the quadratic form and the group are completely analog- 
ous for 7n + 5 and 11n + 6. We collect these results in a theorem. 


Theorem 1. For (t, r) = (5, 4), (7, 5) or (11, 6), 


1 < 
, Pitn + r)q"*! = qe, 
H (934) 3. dL 


aeZ' 
~ Pe -1 
where Q(a) = |||? — i= o %iMi+1- 


It should be noted that other identities for the generating functions of p(tn + r), 
which yield Ramanujan’s congruences, have been found by others. The most 
famous of these is Ramanujan’s [19, (17) p. 213] identity for p(Sn + 4), which was 
considered by Hardy in agreement with MacMahon as Ramanujan’s most beau- 
tiful identity [19, p. xxxv]. Ramanujan [19, (18) p. 213] also found an analog for 
p(7n + 5). In fact for t = 5*, 7* similar identities have been found by Watson [20]. 
Using the theory of modular functions an analog for p(11n + 6) was found by Fine 
[8, (3.25)] and extended to higher powers of 11 by Atkin [4]. However, these other 
identities are of a different nature than (3.2) and do not yield obvious cranks. 
Further, Fine’s identity for t = 11 and Ramanujan’s identity for t = 5 or t = 7 are 
dissimilar so it is surprising that an identity like (3.2) holds for all three values t = 5, 
7 and 11. 
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Finally we come to the cranks. An obvious statistic, which is increased by 
1 mod 5 each time the a’s are cyclically permuted is }'?_ , ix;. So in terms of the a 
basis the crank is clear, but in terms of the n basis (given combinatorially in §2) the 
crank is not clear. 


Theorem 2. A crank statistic for partitions A of Sn + 4, 7n + 5, or 11n + 6 is given by 
the following algorithm. 


(1) Find the t-core i of A, (t = 5, 7, or 11) by Bijection 1. 
(2) Find $,(A) = n by Bijection 2. 
(3) Let crank(A) be the following mod t linear combination: 


(t = 5) 4ny + ny + nz + 4n, for 5n + 4, 
(t = 7) 4ng + 2n, +n, + ng + 2ng + 4ng for 7n + 5S, 


(t= 11) 4n9 + 9n, + Sn, + 3n3 + ng + Ng + 3n, + Sng + 9Ng + 449 for 
lin + 6. 


The new crank is not equal to the rank or the old crank. One can verify this on 
the 5 partitions of 9 which are 5-cores: 621, 522, 51111, 33111, and 321111. 


4. More cranks 


The cranks in §3 depend only upon the t-core A of A, and thus use Bijections 1 and 2. 
In this section we give two simpler ways (Proposition 1 and Theorem 3) of 
computing crank(A), (one which is a polynomial in the parts of 4), thus avoiding 
Bijections 1 and 2. 

First, let r,(A) be the number of cells in the t-residue diagram of A which are 
labeled k mod t. Suppose that / is a t-core. A relation between the r,’s and the n;’s 
can be found by counting the cells in a row ending with i in region n;. It is 


r= Y, (n/2 + nib) (41 


(S) = 1/2 if S is true, 
Mo) =") — 1/2 if Sis false . 


It is easy to see that (4.1) implies 
Nh=Tk—Thk+1 > 


so that the relation in (4.1) for ro for t-cores becomes 


t-1 
ie 2. (r? —riri+1)- 
i=0 


The cranks in Theorem 2 are defined by a linear combination of the n;’s. Using 
(4.2), we can find mod t equivalent linear combinations of the r,’s. 
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Proposition 1. The following mod t linear combinations of the t-residue numbers r, 
are crank statistics: 


(1) r,; + 2r, — 2r,; — rg for Sn + 4, 
(2) 2r; +r. +173 —r4—1rs — 2r,¢ for 7n + 5, 
(3) — 6r, — 4r, — 2r3 — 2rg—rs +76 + 2r, + 2rg + 4ro + Ori. for 11In+6. 


Proof. We already know from Theorem 2 that certain linear combinations give the 
crank for t-cores, e.g. (2, —1, 1, —2) for t = 5. If we multiply this linear combina- 
tion by 3, we obtain (1) for t-cores. We reverse the sign to obtain (2), and (3) is 
immediate from Theorem 2. Now consider (1)—(3) as definitions of a crank for any 
partition A, not just t-cores. Removing a rim hook of length t from A reduces each 
r, by one. The above linear combinations do not change, since the sum of all 
of the coefficients is zero. Thus the crank can be defined by Proposition 1 for all 
partitions 2. O 


Next, we give a definition of a crank based upon the parts of 
Ah fed: .. owe 


Theorem 3. For t = 5,7 or 11, let p,(x) = (x — (t — 1)/2)'~ 3 mod t. A crank statistic 
for partitions 4:1, 24,2 ... 2A, of tn + r (where r = 4, 5, and 6, respectively) is 
given by 


crank(A) = >}. (p,(A; — i) — p(i— 1)) modt. 
i=1 


Proof. Let a; be the coefficient of r; in Proposition 1. Recall that 
a, +a,+...+4,_,=0. 

First we evaluate the contribution to the crank in Proposition 1 from the first 
row of 4. The t-residue diagram of / has an x = A, — 1 mod t at the end of the first 
row. Then the contribution of this row to the crank is 


Q,+a,+...+4,. (4.3) 


It remains to find a polynomial whose values at x = 0, 1,..., t — 1 agree with (4.3) 
mod t. Here are such polynomials: 


(1) 45(x) = 3(ps(x) — 4) for t = 5, 
(2) q7(x) = —(p7(x) — 4) for t = 7, and 
(3) 411 (%) = Pus (x) — 4 for ¢ = 11. 
Thus we have shown that the first row contributes q,(x) = q,(A; — 1) — q,(0) mod t. 
Consider row i of the t-residue diagram of /: the first entry is 1 — i mod t, and 
the final entry is A; — i modt. The contribution of this row to the crank is 


AQ, +Q,+... $@,-;+ (Gai-it-.- +4-1)= 
Q,+a,+...+4,-;-(, +... +4-)) = 44 — i) — a(t — i) modt. 
Thus 


crank(A) = s (q,(A; — i) — q,(t — i) modt . 


i=1 
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Since q,(t — 1 — i) = q,(i) modt, and q,(i) is a linear function of p,(i), the result 
follows. O 


5. Associated q-series 


From (2.1) there is an explicit generating function for the partitions of n which are t- 
cores. We investigate these functions for t = 5, 7, and 11, and give explicit formulas 
for a(n) and a,(n) in Theorems 4 and 5. 

The five cycle in §3 implies that a,(Sn + 4) = 0 mod 5. However, much more is 
true, 


as(5n + 4) = 5a;(n) . (5.1) 


We give two proofs of (5.1): one which is analytic, and proves more (Theorem 4), 
and another which is a bijection. 


Theorem 4. Let n+ 1 = S‘p{'... p%*q’! .. . q® be the prime factorization of n + 1 
into primes p; = 1, 4mod 5, and q; = 2, 3 mod 5. Then 
—** eS | qyi** +(—1)% 

—1 j=1 qj + 1 4 





as(n) = 5° [] F 


Proof. Clearly (2.1) implies 
e (9°34? zm 
a;(n)q" = 4 
» : " (iD Da 


However an identity of Ramanujan ([2, (3.46)] or [6]) is 


(q°34°)3, AG Teese q’ 
‘a. Ste 


where (7) is the Legendre symbol. Clearly the right side of (5.2) is 


d\n , 
pe sll 


d\n 
—1)= —]}-. ; 
as(n — 1) ¥(5)3 (5.3) 
Since ($)/d is multiplicative, (5.3) and [12, Theorem 265] implies that a,(n — 1) is 
multiplicative. It remains to evaluate a;(p* — 1) for primes p, which can be done by 
(5.3). O a 

The combinatorial proof of (5.1) is explicit: given a partition A of n which is a 5- 
core, find five partitions 09, 0,, 42, 03, 04, of Sn + 4 which are also 5-cores. Let 
(A) = m. We now give the i image under @, of the five partitions of 5n + 4. 


(1) @2(89) = (m, + 2m, + 2m, + 1, —m,—m,+m,+m,+ 1, 2m, +m, 


+2m3;, — 2m, — 2m, —m,—1, — 2m, —m, — 2m, — 1), 
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(2) $2(0,) = (2m, + 2m, + 1+m,, —1—m,— 2m, —2m,, 
— 2m, — 2m, — mg, m, + 2m, + 2m3, — m, +m, +m, —ms3), 

(3) $2(0,) = (m, — m, — m, + m,, 2m, +m, +1+2m;, —m, — 2m, 
—1—2m,, — 2m, — 2m, — m,, 2m, + m, + 2m,), 

(4) $2(03) = (— 2m, — m, — 2m,, — m, — 2m, — 2m;, 2m, + 2m, + 1+ m3, 
m, +m, —m,— 1 — mz, 2m, + 2m, + mg), 


(5) $2(04) = (— 2m, — m, — 2m, 2m, + 2m, + m3, m, — m, + Mm, — M3, 
m, + 2m,+1+2m;, — m, — 2m, — 2m, — 1). 
We delete the verification of this claim. In fact, these five partitions 6; form an 
orbit under the five cycle, and 


crank(@;) = 3i mod5. 


We denote by y, the 5 — to — 1 map from the set of 5-cores of 5n + 4 to the set of 
5-cores of n, y,(0;) = 4 forO0 Si <4. 

For t = 7, we have a,(7n + 5) = 0 mod 7. It is not true that a,(7n + 5) = 7a,(n). 
There are however two multiplicative functions here. The identity which is analog- 
ous to (5.2) is due to Ramanujan [8, p. 159] 


aq? F341 ® + 4(q747)3.(9:9)3, = iG. (5.4) 


(930 q")° 


Let a’(n), b(n), c(n) denote the coefficient of q” in the expansion of each of the 
three functions in (5.4) so that 


8a,(n) = a(n + 2), 
a(n) + b(n) = c(n). 


We will give in Lemmas 1 and 2 explicit formulas for b(n) and c(n), resulting in an 
explicit formula for a(n) in Theorem 5. 

The proof of Theorem 4 analogously establishes the multiplicativity of c(n). We 
delete the details. The resulting explicit formula is given in Lemma 1. 


Lemma 1. If n = 7°pi1.. . pq’! . . . q? is the prime factorization of n into primes 
p; = 1, 2, 4 mod 7, and q; = 3, 5, 6 mod 7, then 


s t g?bs+2 — 1) 
cya fy et eS 


j=1 qj +1 
To establish the Per sist of the sequence b(n), we apply the theory of 
modular forms. 


ail - 








Proposition 2. The sequence b(n) is multiplicative, moreover 


b(p") = b(p)b(p"~*) — () p>) 


for any prime p and integer m = 2. 
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Proof. If q = e**”, the generating function B(z) for b(n) (see (5.4)) can be considered 
a function of z in the upper half plane. In terms of the classical y-function it is 
B(z) = (n(z)n(7z))°, which is a cusp form of level 7, weight 3, and character 
x(n) = (5) [14, Prob. 12, 13, p. 145]. Since this space of cusp forms is one- 
dimensional, B(z) must be an eigenform for the Hecke operators T,,. This proves the 
multiplicativity of b(n), and the three term recurrence follows from the Euler 
product for the associated Dirichlet series [14, p. 160 (5.11)]. O 

To find an explicit formula for b(n), we need only find b(p) for all primes p. The 
three term recurrence in Proposition 2 gives b(p”), and multiplicativity gives b(n) 
for all n. The next proposition gives the values of b(p). 


Proposition 3. Suppose p is an odd prime. If p = 3, 5 or 6 mod7, then b(p) = 0. If 
p =1, 2 or 4 mod7, let p = x? + 7y?, where x and y are positive integers. Then 
b(p) = 2(x? — Ty”). 


Remark. The result also holds for p = 2 except in this case x = y = 3. 
Proof. From Jacobi’s identity for (q;q)3, [12, Thm 357] we find that 
b(p) = - (—1)"*"(2m + 1)(2n + 1). 


(2m + 1)2 rae) A 1)? = 8p 
We need to determine all of the solutions (m, n) to 
8p = (2m + 1)? + 7(2n + 1), (p1) 


where m, n 2 0. Clearly the right side is a quadratic residue mod 7, so if p = 3, 5 or 6 
mod 7, there are no solutions (m, n) to (p1) and b(p) = 0. 

Thus we can assume that p = 1, 2 or 4 mod 7. We first show in this case that p 
has a unique representation p = x” + 7y” for positive integers x, y. We work in 


‘ 7 1+./-7]. : 
K = Q(./ —7), whose ring of algebraic integers, O, = Z jy" | is a unique 
factorization domain [12, Th. 246]. Since 


-7 
1= (2) = (<3) (by quadratic reciprocity) , 


p divides a? + 7 for some integer a. Since p does not divide a + ./ —7, p is not 
prime. Thus p splits 


p= BB, 

where B = x + y,/ —7 is prime in Ox and x,y >0. Now, x, yeZ, otherwise 
x=m+4, y=n-+4 (for some m,neZ), p = m(m + 1) + 7n(n + 1) + 2 which is 
even and contradicts the assumption that p was odd. Hence p = BB = x? + 7y? for 
some positive integers x, y. The uniqueness of the representation follows from 
unique factorization, and the only units being +1. 

We next show that (p1) always has two solutions (m, n), whose contribution to 
b(p) is 2(x? — 7Ty?). (p1) is equivalent to 2p = yy, where 


PP a Sth eadin« tet tel =F 


2 2 





»Xq, yy, >0. 
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Let 





(A) =a 


5) TT . 


It follows that 2p factors as 
2p = (xB)(xB) = (xB) (xB) = yy - 

By unique factorization we must have y = +2, +7$, +2B, or y= +2. This 
allows eight possible solutions (x,, y,), six of which violate x,, y, > 0. The two 
solutions can be explicitly given, depending upon which of the three inequalities 
0=y<Ty<x,0<x<y</7y, or 0 < y<x</7y occur. In each of these three 
cases we find b(p) = 2(x? — 7y”) as required. O 

For p = 1, 2 or 4 mod7 note that Proposition 3 implies that b(p) + 0, since 
b(p) = 0 would imply that x? = 7y?, and thus p = 14y? = 0 mod7. We also note 
that b(p) = 2(x? — 7y?) = B? + B? where p = BB, B=x+y./ —7 and x,y>0. 
Using the three term recurrence in Proposition 2 and the value of b(p) in 
Proposition 3, the value of b(p™”) is easily found. It is given in the next lemma. 


Lemma 2. Let n = 7°p%'.. . p%*q°! . . . qd? be the prime factorization of n into primes 
p; = 1, 2,4 mod 7, and q; = 3,5,6 mod 7. Let p; = x7 + 7y;7 for some positive integers 
X;, y; in the case when p; is odd and x, = y, =4 for the case p, = 2. Then 


b(n) = 0 if some b; is odd , 


aii ee R2a;+2 t 
t t 


Bb? — B? mae 





q} otherwise , 


b(n) = (—7F TI 
where B; = x; + y;,/ —7. 


Note that Lemma 2 implies that b(p”) = 0 if, and only if, p = 3, 5 or 6 mod7 
and m is odd. We can now state the explicit formula for a;(n). 


Theorem 5. Let n + 2 = 7°pi'. . . p%*q%' . . . q?* be the prime factorization of n + 2 
into primes p; = 1, 2,4 mod7, and q; = 3, 5,6 mod 7, then 


a,(n) = 3(c(n + 2) — b(n + 2)). 
where c(n) and b(n) are given in Lemmas | and 2 respectively. 


We state relations which are corollaries of Theorems 4 and 5. 


Corollary 1. The following relations hold: 


(1) a,(S¢m — 1) = S*a,(m — 1) = 0 modS’, 
(2) a,(7*m — 2) = 0 mod7’, 

(3) a,(49n + 19) = 49a,(7n + 1), 

(4) a,(49n + 33) = 49a,(7n + 3), 

(5) a(49n + 40) = 49a,(7n + 4). 


Proof. (1)-(5) are immediate from Theorems 4 and > iia 2 
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For a, ,(n) there are identities for cusp forms which prove 
a,,(11%m — 5) = 0 mod 11* (5.5) 
and 
a,,(43n — 5) = 0 mod 44 for (n, 43) = 1. (5.6) 
We delete the proofs of (5.5) and (5.6). 


6. A crank for p(25n + 24) 


We can define a group G which acts on the set of partitions of tn + r:G = G, x S,, 
where G, is the automorphism group of the quadratic form in Bijection 2, and S, is 
the symmetric group on t letters. For example, for 5n + 4,G = D, x S,;, where D, 
is the dihedral group of order 10. We have concentrated on the action of G, for 
congruences. We can also use S, for congruences, and do so in this section to find a 
crank for 


p(25n + 24) = 0 mod25. (6.1) 


The group G = D, x S, for 5n + 4 contains two commuting five cycles which 
generate a subgroup of order 25. If each five cycle has no fixed points, then G will 
have no fixed points, and the orbits of G will have size 25. We have seen that the five 
cycle inside D, has no fixed points. Since the five cycle in S; could have fixed points, 
we consider two cases to define the crank, which will be an ordered pair of integers, 
each between 0 and 4. This ordered pair could be considered as the base 5 
expansion for a number between 0 and 24. 


Theorem 6. A crank statistic for partitions 4 of 25n + 24 is given by the following 
algorithm. " 

(1) Find $,(A) = (A, 49, 44, 42, 43, 44) given by Bijection 1. 

(2) Let crank(A) be the following ordered pair of integers: 


Suppose that Ay = A, = A, = A3 = Aq, so that 1 is a partition of 25s + 24 for 
some s. Let Uy = )5,+4(A) and pt, = y,(u,) be partitions of 5s + 4 and s respectively 
(see §5). Put 


crank(d) = (crank(y,), crank(p2)) . (i) 


Suppose that some 4; + 4;, so that the five cyclic permutations of (Ag, 4,, 42, 43, 
44) are distinct. Order these five tuples in lex order, and define the crank of the ith 
tuple to be i — 1. Put 


crank(A) = (crank(A), crank((Ag, 41, 42,43, 44))) - (ii) 


Proof. The vectors y,,(0;) = Ain §5 form an orbit under C; < G,, so that the cranks 
of these five partitions are {0, 1, 2, 3, 4}. 


The second part of the definition similarly interprets C; x C,, as a subgroup 
of G. O 
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In Theorem 6(2)(ii) the lex order crank can be replaced by the following 
statistic. Find ¢, (A), and if 


[Aol + [Ai] + [42] + 43] + [44] = 0 mod 5, 
define the crank as in Theorem 6(2)(i). Otherwise define 
crank(A) = (crank(A), JA,| + 2|A,| + 3]A3| + 4|A,| mod 5). 


It is clear that the five cyclic permutations of the A; will give five distinct cranks for 
the second component. 


7. Self-conjugate partitions 


In this section we consider the restriction of Bijections 1 and 2 to self-conjugate 
partitions. Let asc,(n) be the number of t-cores which are self-conjugate. 

In Bijection 1, suppose that A is self-conjugate. Then / must be self-conjugate, 
and /; = /,_;-,,0<i<t—1. Since (—g; q’),, is the generating function for self- 
conjugate partitions, the self-conjugate version of (2.1) is 


oO 


¥ asc,(n)q" for t even , (7.1a) 


«a2 iad 
(B10 = Garg 


ey, Le 4 " for t odd (7.1b) 
(-434°)o = Gagne p™ asc,(n)q" for t odd. ; 
While there are congruences for qo(n), the number of self-conjugate partitions of 
N, €.8. do(125n + 99) = 0 mod 5, it is not obvious how to prove these congruences 
from this approach. Nevertheless, for t = 5 there is a nice Lambert series, and a 
theorem analogous to Theorems 4 and S. 
The Lambert series is 
@°:a%, _ q’ 
— 439") « ——=~—)— = n)——. , (7.2) 
4 — 439°) (5. gid) 2 120") 7 


if (n, 10) > 1, 
otherwise . 


0 
X20(n) = | 


1 
(-1pe-» 


Thus only odd n occur in (7.2), and the appropriate signs for odd n mod 20 are 
+ —0-— + — +0+ —.(7.2) follows from the ,y, summation formula [2, (3.1)]. 
The identity (7.2) also follows from an identity of Ramanujan [21, (1) p. 60] and 
Jacobi’s formula for r,(n), the number of representations of n as a sum of two 
squares [12, Thm 278]. The functions r,(n) and asc,(n) are related by 


5 


As before we obtain from (7.2) the following theorem. 


r,(n) — r(3) = dascs(n — 1). (7.3) 
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Theorem 7. Let n + 1 = 2°54pt' ... p%*q’! .. . gq? be the prime factorization of n + 1 
into primes p; = 1 mod 4, and q; = 3 mod 4. Then 


s t 
asc;(n) = [| (a, + 1) [] (@ +(-1)”)/2. 
i=1 j=l 
A surprising corollary results. 


Corollary 2. The following relations hold: 


(1) asc,(2n + 1) = ascs(n), 

(2) asc,(5n + 4) = ascs(n), 

(3) asc;(n) = 0 if and only if there exists a prime q = 3 mod 4 and an odd integer 
b such that q’ exactly divides n + 1. 


There is a nice combinatorial proof of Corollary 2(2). Suppose 2 is a self- 
conjugate partition of Sn + 4 which is a 5-core. It is easy to see that only 0p of §4 is 
self-conjugate. Thus, the restriction of the map jy, to self-conjugate partitions is a 
bijection. 

A similar bijection exists for Corollary 2(1). Just replace (n,,n,) in (7.4) by 
(—n, +n,, —n, —n, — 1). We do not have a combinatorial proof of Corollary 
2(3). 

In Bijection 2, clearly we have n;= —n,_,-;, so the generating function 
becomes 


asc(n)g"= Y q' suliiahcted (7.4) 


ie ZW 


a 24...,t-f for t odd , 
~ )(1,3,...,t-1) fort even, 


and [t/2] is the integral part of t/2. Using (7.4) dissections of (—q;q7),. due to 
Kolberg [16] can be easily derived. 


8. Partitions with distinct parts 


A bijection analogous to Bijection 1 for partitions with distinct parts has been 
given by Morris and Yaseen [17]. In this section we give the appropriate version of 
Bijections 1 and 2 for these partitions. 

We begin with notation. Let pd(n) be the number of partitions 4 of n with 
distinct parts. Given such a A, the shifted Ferrers diagram of A, S(A), is the Ferrers 
diagram of A with the ith row shifted to the right by i — 1 cells. The doubled 
partition of A, denoted AA, is defined by adding /; cells to the i — 1st column of S(A). 
For example, if A = 31, then AA = 431. We let DD denote the set of doubled distinct 
partitions 1A. We define the t-core of A/ as the usual t-core of AA. Let DD, ~ -o,¢ be 
the set of partitions which are t-cores of doubled distinct partitions, and let add,(n) 
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be the number of these which are partitions of n. We state without proof that 
DD, - core < DD, thus add,(n) = 0 if n is odd. 
By restricting Bijection 1, we find a bijection for doubled distinct partitions. We 
must take the conjugate of the A, in ¢, to find A, for ¢3. 
Bijection 3. There is a bijection ¢,: DD + DD,_..,. x DD x P x ... x P, 
(Ad) = (AA, Ag, As. «5 p= a) 
such that 2|A| = |AA| = |Ad| + tt} A,|, and A,_; = 41, for 1 <i<t—1. 
The generating function identities equivalent to Bijection 3 are 
| FOr eS é 
a0 = Gig ,d, add,(n)q" for t odd. (8.1a) 


(-4'3q')o << . 
= Gaga? s add,(n)q" for t even. (8.1b) 


Bijection 4. There is a bijection 4: DD,— core > {n = (Mo, Ny, ..-, M1): nj€Z, 
Ny = 0,n, = —n,_;,1 SiS<t— 1}, where 
|AA| =tln|2/2+5-n, b=(0,1,...,t—1). 
The generating function identity equivalent to Bijection 4 is 


add,(n)q" = = qin +d-n ‘ 


n=0 ne Zit- 121 


+ f(1,3,...,t-2)  fortodd, 
i Z4&...,t=2 for t even . 


9. Remarks 


Naturally it is desirable to prove the general congruence for powers of 5, 7, and 11 
found in [4, 20]. It would be natural to assume that the symmetry group of the 
quadratic form for t = 57°11¢ contains a cycle of the appropriate length. We have 
not been able to find this cycle. Our crank for p(25n + 24) was inspired by Bailey’s 
({6], [2, p. 465]) proof of Ramanujan’s congruence for p(Sn + 4). In fact Bailey’s 
method also yields the congruence for p(25n + 24). It may be possible to extend our 
methods to obtain a crank for p(49n + 47) and p(121n + 116). First we need to find 
a crank for a,(49n + 47) and a,,(121n + 116). Our present method does not 
succeed in these cases since there is no analog of (5.1). It may be easier to find a 
mod 49 crank for p(49n + 19), p(49n + 33), p(49n + 40) in view of Corollary 1(3), 
(4), (5). 

In [11] the symmetry groups of the forms associated with p(tn + r) fort < 8 
and all r were computed. The symmetry groups for p(11n + r) for r + 6 need to be 
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found. There is reason to believe these groups are larger than C,. It seems that an 
unusually high proportion of the coefficients of a,,(n) are divisible by 11 so there 
may be more 11-cycles. A higher proportion of the coefficients are divisible by 5. In 
fact, using modular forms which appear in an analog of (5.4) for t = 11, we can 
prove the following theorem. 


Theorem 8. If (7;) = 1 and n not divisible by 5, then a,,(n — 5) = 0 mod 5. 


We can prove by a bijection from (7.4) that 
asc,(4n + 6) = asc,(n) . (9.1) 


Further, by utilizing Gauss’ result for sums of three squares [12, p. 311] it can be 
shown that 


asc,(n)=0 if and only if n + 2 = 4°(8m + 1). (9.2) 


(This observation was made by Doug McDoniel.) 

Kolberg [15, 16] has given several infinite products for dissections of p(n), q(n) 
and qo(n). Many of these results (for q(n) and qo(n)) follow easily from (7.4), (8.2) and 
the Jacobi triple product formula. 

John Stembridge informed the authors of the existence of [17, 18] for distinct 
partitions. It should be noted that the definition of t-core given in §8 for t-even does 
not agree with [17, 18]. 
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Classification of subfactors: the reduction to commuting 
squares 


S. Popa 


University of California, Los Angeles, Department of Mathematics, Los Angeles, 
CA 90024, USA 


Introduction 


In [ J1] Jones introduced the notion of index of a subfactor of a type II, factor. This 
concept, as well as the results in [J1], proved to be very deep and enlightening for 
numerous aspects of the theory of type II, factors. One of the surprising results in 
[ J1] is the characterization of the possible values of indices of subfactors (less than 
4) as being the same as the set of square norms of matrices with nonnegative integer 


: , T 
entries (up to 4), that is 4cos*—, n2= 3. 


Among the operator algebraic problems arising from Jones’ work the most 
important are the characterization of all real values > 4 that may occur as indices 
of subfactors N < M with trivial relative commutant N’ 7 M = C and the classifi- 
cation of subfactors having the same index when the ambient factor M is the 
hyperfinite II, factor. One way to approach these problems is by finite dimensional 
approximation. This means to construct finite dimensional subalgebras B, < M so 
that B, 1 M, A, = B, 0 N17 N. In addition the algebras A, < B, should satisfy the 
so-called commuting square condition (*) Eg E,,, = E,4,, Eg denoting the trace 
preserving conditional expectation onto B. The subfactors in [J1] do have this 
approximation property and in fact the corresponding sequences A, < B, are 
uniquely determined by an initial commuting square 


Bo c B, 
U U 
Ay © A;, 


the rest of the sequence being obtained by an iterative construction. 

We prove in this paper a generating result for pairs of hyperfinite factors 
N c M which will show in particular that all subfactors of index [M:N] less than 
4 arise in this way, from an initial commuting square of finite dimensional algebras, 
with inclusion matrices of norm [M:N]' and having dimensions and traces 
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determined by these matrices. This result reduces the classification of such sub- 
factors to the classification of some finite dimensional commuting squares and this 
in turn is a purely combinatorial problem. To describe in greater detail our results 
we'll recall some of the necessary background. 

It has been noted by various people (Pimsner-Popa, Jones in 1983, Ocneanu 
1984) that there are some (almost) canonical finite dimensional subalgebras 
B, < M, associated to N c M, that satisfy ( * ): these are the relative commutants in 
M of the algebras in the Jones’ tunnel of subfactors M> N>N,>N,2>..., i. 
B; = N;AM. At each step i, N; (and thus B;) are unique only up to unitary 
conjugacy by elements from the previous step N; _, (cf. [PiPol]). And the problem 
was posed on whether one can choose the tunnel N; such that N; 7 M generate M 
and NN; N generate N, a result that would reduce the study of N c M to a study 
of finite dimensional commuting squares. 

Ocneanu was the first to realize that this generating problem may have a 
positive solution if N'A M =C and supdim #(N;7M) < ©, a condition he 
called finite depth (in fact an equivalent form of it). Since if 
NcMcM,cM, c... is the Jones’ canonical tower of factors associated to 
N cM then the finite dimensional algebra N; 7 M is antiisomorphic (and thus 
isomorphic) to M’q M;,,, the condition sup dim #(N;- M) < oo is the same as 
sup dim 2(M’ a M;) < oo. 

We prove in this paper the following generating result, without N’\ M = C 
being assumed. 


Theorem. Let N < M be a pair of hyperfinite I1, factors with finite index. Assume 
the Jones’ tower of factors NC Mc M,c<M, cc... satisfies 

sup dim Z(M’m M;) < 0. Then there is a choice of the tunnel of subfactors 
M>N2>N,>N,... such that N;AMtM, N;ANTN. Moreover if 


M= | );M; then the pairs N < M and M0 M < M'aM are antiisomorphic. 


The case N’ M = C of this result has been announced at various conferences 
during 1987-1988 by Ocneanu ([Oc]), however without presenting a proof since 
then. 

The above theorem reduces the classification of subfactors with the property 
sup dim 2(M’ 7 M;) < © to the classification of sequences {N; A N ¢ Nin M};j. 
But these sequences are uniquely determined by an initial commuting square 


Ni, OM & Nig OM, 
U U 
Ni, ON € Nigar ON, 


for some ig large enough, with ip, the inclusions, the dimensions and the traces 
determined by some integral matrices of norm [M:N]!/?. Moreover, since 
[M:N] < 4 implies the finite depth condition, we get a complete classification of 
subfactors of small index in terms of commuting squares: 


Theorem. The conjugacy class of a subfactor N <M with finite depth of the 
hyperfinite 11, factor M is uniquely determined by the isomorphism class of a 
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commuting square of finite dimensional algebras canonically associated to the inclu- 
sion N < M. Moreover, the subfactors of index < 4 automatically satisfy the finite 
depth condition, so they are all classified by their corresponding commuting squares. 


So the problem remains to classify the corresponding commuting squares. In 
case the number is small (for instance <2 + /5) their number can actually be 
estimated. Moreover, in the case [M:N] <4 the analysis of the commuting 
squares has to do only with the simple matrices corresponding to the Dynkin 
diagrams A,, D,, E,, E7, Eg, (these are all possible matrices of norm < 2). One can 
actually obtain: 


Corollary. For each n = 3, there are only finitely many subfactors (up to conjugacy) 


of the hyperfinite II, factor, with index 4cos* ai 
n 


In [Oc], Ocneanu gave an intrinsic characterization of the sequences 
{N;QN <N;M};, in case N'A M =C, describing them as group-like objects 
and announced a full list of such objects for [M:N] < 4. Thus a complete list of the 
subfactors of index < 4 of the hyperfinite II, factor can actually be given. 

An important application of the case N'~M+C of the theorem is the 
classification up to outer conjugacy of (not necessarily outer) actions of finite 
groups G on the hyperfinite II, factor R and more generally of the classification up 
to conjugacy of the subgroups isomorphic to G in Aut R/int R (i.e. Jones’ theorem 
in [ J3]): this follows by taking a partition of the unity with |G| projections p, of 
equal trace in M, R = p,Mp, and by taking N = {@,.¢g(x)|x¢ R = p.Mp, }, where 
gé€ Aut R is a lifting of G c Aut R/Int R. This application will be discussed in a 
more general setting in a sequel to this paper. 

The proof of the theorem is based on the key observation that if 
sup dim #(N; M) < oo then the algebras B = N; v (N; 7 M) satisfy E,(x) = cx, 
xéM,, with a constant c > 0 independent on i (see 3.8, 4.3). Since N; are all 
hyperfinite (cf. [C]), N; v (N;a M) can be approximated by relative commutants 
Ni, M,k > i(see 4.4). Thus, by using the inequality one can choose recursively the 
tunnel N; such that R = ();(N;7 M) satisfies Eg(x) 2 cx, x€M,. By [PiPol] this 
means R has finite index in M, [M:R] < c”*. The inequality also shows that given 
xéM_, and a choice of N; up to j, there is a choice of N;,j < i < k,so that Nj; 0M 
contains a certain “percentage” of x. If this would be true for arbitrary x then the 
resulting R would equal M. If not, there would be xe M and j so that x LuRu* for 
all unitary elements u in N ; (4.6). But by the Rohlin type lemma in [P04], used here 
in a form we call the linearization principle (5.1), one has span uRu* = spanN RN; 
= M. Thus x = 0 and the theorem is proved (4.9). Then Section 6 contains 
applications of the main theorem to the classification of subfactors. 

The uniform bound from below Ey , (y;..my(*) 2 cx, xEM,, i2 0, can be 
deduced from [Po3]. We included a complete and different proof here for the 
reader’s convenience. The proof is a consequence of the uniform bound for local 
indices obtained in Section 3, which in turn follows by the general results on 
sequences of commuting squares in Section 2. Part of the algebraic considerations 
in Section 3 are of a similar type to some work in [W], [GHJ]. 
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The proof of the main theorem in this paper was presented at the Annapolis 
Conference on “Knots and Operator Algebras” May 1988 and at the A.MS. 
Summer Institute on “Operator Theory and Operator Algebras” August 1988. 


1. Preliminaries 


1.1. Jones’ basic construction and the tower of factors. Let M be a finite von 
Neumann algebra with a normal finite faithful trace t, 7(1) = 1. Denote || x||, 
= 1(x*x)!/?, for xe M, and L?(M, t) the completion of M in the norm || ||>. 

If B < M isa von Neumann subalgebra of M then we denote by E, the unique 
T-preserving conditional expectation of M onto B. Also, we denote by eg, the 
orthogonal projection of L?(M, t) onto L?(B, t) < L?(M, 1). Ex, the projection e, 
and the canonical conjugation J on L?(M, 7), defined by Jx = x*, are related by the 
properties: 


1.1.1 (i) If xe M then xe B iff [x, e,] = 0. 
(ii) egxeg = Ep(x)eg, xE M. 
(iii) [J,e,] = 0. 


If M is a type II, factor and N = Bc M isa subfactor then the Jones’ index of 
N in M, [M:N], is the Murray and von Neumann coupling constant of N in its 
representation by left multiplication on L?(M, 1). Thus, the finiteness of [M:N] 
means that N’ (or equivalently JN’J) is finite, and its value can then be recuperated 


as t(ey) ', t being the (unique) normalized trace on JN’J. The construction of the 
finite factor JN’J is in fact a major tool in studying subfactors: it is called the Jones’ 
basic construction. We list now some of its properties: 


1.1.2. Assume [M:N] < oo. Define M, = JN’J. Then M, is a type II, factor and 
we have: 


(i) M, =(M Vv {ey})” = span{xeyy, x, ye M}. 

(ii) [M,:M] =[M:N]. 

(iii) t(eyx) =[M:N]~‘'t(x), xeM, t being the unique trace on M, with 
i eae 


Thus, starting from the initial inclusion N c M, the basic construction builds a 
new inclusion M c M,, with the same index, with a projection e, = ey of trace 
[M:N]~* implementing the conditional expectation (like in 1.1.1). We call e, the 
Jones’ projection corresponding to N <M and write the basic construction 
M c*'M,. 

We mention that in fact M, can be described abstractly: it is the unique II, 
factor that contains M and a projection e, so that M and e, generate M, and so 
that e,xe, = Ey(x)e,,xeM (cf. [PiPo2]}). 

By iterating this construction we get a whole tower of factors 
NcMcM,cM,c.,..., with projections e,,e,,...,s0 that M;c “*! M;j,, 
is the basic construction for M;_, < M;. They satisfy: 





Classification of subfactors: the reduction to commuting squares 23 


1.1.3. (i) e:41:X@:4, = Ey,_,()e;41, in particular e;,,e,e,,, =[M:N]~‘'e,,,. 
Also, e;¢;,,¢; = [M:N] ‘e;. 

(ii) e;4,;€M;_-,0M;,,. In particular ee; = e,e;, for |i — j| = 2. 

(iii) t(e;, , x) = [M:N]~' 1(x), xe M;. In particular t(e;, , w) = [M:N]~' 2(w), 
for we Alg{l,e,,e2,...,e;}. 


1.2. The finite dimensional case. If N < M are finite dimensional then we can still 
define M, = JN’J, which will be finite dimensional as well and will satisfy proper- 
ties similar to 1.1: 


1.2.1. M, =(Mv {e;')” = span{xeyy|x, ye M}. 


Moreover if M is any algebra containing a copy of M and a nonzero projection 
e satisfying: 


(a) [N, e] = 0; 
(b) xe N, xe = 0 implies x = 0; 
(c) exe = Ey(x)e 


then Xxeyy++2xey defines an isomorphism of M, onto the algebra 
span{ xey|x, ye M < M}. This observation gives an abstract characterization of 
M, (see. e.g. [W]). We call M c M, with the projection e, the algebraic basic 
construction for N < M and Ey. 

By the definition of M, there is a natural isomorphism z++JzJ between the 
centers of N and M,. It can be alternatively described by: “JzJ is the unique 
element z,¢2%(M,) satisfying z,ey = zey”. This gives a natural identification 
between the sets of simple summands of N and M,. If we denote by K this common 
set and by A = (4,;)ex the inclusion matrix of N c M then the inclusion matrix of 
McM,isA. — 

The case when M, has a trace which extends the trace of M and satisfies a 
property similar to 1.1. was clarified in [ J1]: 


1.2.2. Let (s,),¢x be the traces of the minimal projections of N and (t,),., those of M. 
Then the following conditions are equivalent. 

1°. There is a trace t,; on M, such that t,|y = 7 and 1,(xey) = T,(x)t, (ey), 
xeM. 

2°. AA‘(s,) = A~ '(s,) for some A > 0. 

3°. A‘A(t,) = A7*(t,) for some A > 0. 


Moreover if the conditions hold true then the scalars A of 2° and 3° satisfy 
A = 1, (ey) = || A] ~7, all irreducible components Ag of A satisfy || Ao || = || A|| and 
(s,) (resp. (t,)) is a Perron-Frobenius eigenvector for AA‘ (resp. A‘A). 

Property 1° for the trace on M, is called the A( = t,(ey)) Markov property. If 
the above conditions are satisfied then one can iterate the basic construction 
getting at each step the appropriate extension of traces satisfying the Markov 
property. 

If M c M, satisfies 1.2.2 we simply call it the basic construction and write 
M c°*M,. 
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1.3. The tunnel of subfactors. Jones also showed that given an inclusion of factors 
with finite index N c M, there is a subfactor N, < N and a projection e,é M so 
that N < ©°M is the basic construction for N, < N. This fact is made more precise 
by the results in [PiPol]. There is a unique (up to conjugacy by unitary elements 
uéN) projection eg¢M such that Ey(e¢9)=[M:N]~'1. And if N, = {e9}'AN 
then N, is a subfactor in N with the property that N <°°M is the basic construction 
for N, CN (ie. with eg satisfying e9xeg = Ey,(x)@éo, XEN). In particular N, is 
unique up to conjugacy by unitary elements in N. 

As before, we may iterate this construction k times and get a tunnel of subfactors 
up to k, M >°N >°-!N, >*-?N, >*°-?...>°-**'N,_, > N,, with [N;:Nj41] 
= [M:N], e_;xe_; = Ey,, (x)e_;, XE N;, and t(e_;) =[M:N]7',0Sisk—-1. 

Note however that while the tower N <c Mc *'M, < °M, c (with the corres- 
ponding projections) is canonical and unique, the tunnel of subfactors 


er oy Ns Ss... 


is unique only up to conjugacy by unitary elements, i.e. if N,, N2,...,N, and eo, 
@_1, +--+, @-y4, are chosen then e_,EN,-, and N,,, < N, are unique up to 
conjugacy by a unitary element in N,. 


1.4. Other characterizations of [M:N]. There are two alternative descriptions of 
[M:N] that have been given in [PiPo1]: [M:N]! is the best constant 4 for which 
the basic inequality, Ey(x) 2 Ax, holds true for all xe M,. More precisely, if 


4(M, N) = max {A = O| Ey(x) 2 Ax, xe M,} 


then A(M, N) = [[M:N]~?. In addition, we saw in 1.3 that there is a projection e 
(unique up to unitary conjugacy by elements in N) such that Ey(e) = A(M, N). The 
basic inequality then shows that A(M, N) is the minimal scalar that can be the 
expected value on N of a nonzero projection in M (see more on this in [Po3}]). 

Moreover, the module dimension definition of [M:N] can be made more 
precise: it was shown in [PiPo1] that there exists {m;}; < M, a finite set, such that 
Ey(m¥m,) = 6,;f;, with fe P(N), M = ),m;,N. A set {m;}; like this is called an 
orthonormal basis of M over N. Any such set satisfies }\;m;m¥ = [M:N]-1. The 
projections f; can be chosen to be all but possibly one equal to the identity. 

Such an orthonormal basis obviously exists for finite dimensional pairs N < M 
(and Ey) as well. It can be used to prove the abstract characterization of the basic 
construction in 1.2. Moreover if the conditions in 1.2.2 are satisfied then 2m;m* 
= A~! (A as in 1.2.2). ’ 


2. Sequences of commuting squares 


If M is isomorphic to the hyperfinite II, factor then a natural way to approach 
index problems for subfactors N < M is by approximating the pair N c M with 
pairs of finite dimensional algebras B, < M such that B,tM, B, NTN (see 
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[PiPol, 3]). The natural condition to be imposed on the algebras B, is then: 
Ez, En api Ex.aN (*) 


This is called the commuting square condition ({Po1], [PiPol], [Po2]). Note 
that if B < M satisfies (*) then max {A => 0|Eg,.y(x) = Ax, xe B,} =[M:N]~! (cf. 
[Po2]). 

We will prove in this section some general properties for sequences of finite 
dimensional subalgebras satisfying the commuting square conditions with the 
Jones tower (or tunnel) of factors. We first consider two consecutive commuting 
squares. 


2.1 Proposition. Let N < M <*'M, <°M, be two steps of the tower. Let By < M, 
B, < M,, B, < M,j be finite dimensional subalgebras satisfying E,,Ey,_, = Ez,_,, 
i = 1, 2. Suppose e,€ B, and denote by p, the central support of e, in B,. Then we 
have: 

1°. B, 3x++xp,€B, p, is an isomorphism; 

2°. e,B,e, = Boe, and B,p, = Alg(B,p2 Vv {e,}) = span B,e,B,; 

3°. B, ~ B,p, <®B,p, is the algebraic basic construction corresponding to 
By c B,; 

4°. If we identify the sets of simple summands of By and B,p, via the equality 
Boe2 = €2B 3 e, (see 1.2.1) then the inclusion matrix for B, G Bp, is the transpose of 
the inclusion matrix for By < B,; 

5°. If (S,), is the vector giving the traces of the minimal projections of By then the 
traces of the minimal projections of B,p, are given by (As,),. 


Proof. Let qo = v {ue,u*|ueW%(B,)}. Note that e, < qo S p2, qg€ B, A B, and 
that B, 3x++ xq € B,qo in an isomorphism. Thus, since e,xe, = Eg,(x)e2, x€ B,, 
it follows that if we denote B; = span B,e,B, then the inclusion 
Byqo <°Bz( = By qo) is the algebraic basic construction for By < B, (cf. 1.2). In 
particular the inclusion matrix for B,qg < Bz is the transpose of the inclusion 
matrix for By < B,. 

We now show that qo = p, and that B; = Bp, and this will end the proof. 

To do this we first show that p, = qo. We have qo = p v {I(xe,)|xeB,} and 
P2 = V {l(ye2)|y¢B,}, where /(z) denotes the left support of an element z. But by 
[PiPol] and by the commuting square condition, if x = A~'E,,(ye2) for some 
yeB, then x = 1~'Ey,(ye,) and xe, = ye,. Thus I(xe,) = I(ye,) and qo = p2. To 
prove that B; ( = span B,e,B,) equals Bp, it suffices to show that e,B,e, = Boe. 
Indeed, since p,=qo=),m,e,m* for some m,e€B,, with E,,(m*m,) 
= 6;;f,f5€ P(Bo) it would then follow that 


B2P2 = P2B2P2 = 4oB240 by m,e,B,e,mF 
J 


= bs m;Bye,mF Cc span B, eB, Cc B,p, . 
i, j 


But e,B,e, < e,M,e, = Me, so that e,B,e, = Xe, for some X c M. Thus 
X = 17 'Ey,(Xe2) = 47 Ey, (€2B2e2) < By, so that X — By, AM = By. This 
shows that e,B,e, < Boe, < e,B,e,, ending the proof of the proposition. Q.E.D. 
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From 2.1 we can now deduce the following property for a sequence of 
commuting squares: 


2.2 Corollary. Let N< Mc*'M, <M, cc... be the Jones’ tower of factors and 

B; < M,, i = 0, be finite dimensional subalgebras satisfying Eg,Ey,_, = Ep,_,,i 2 | 

and e;€ B;, for all 2 < i<n (where 2 <n oo). Let K; (respectively L;) denote the 

sets of simple summands of B,; (respectively B,;,,),n > i = 0, and identify K; (resp. 

L,) with a subset of K;,, (resp. L;,) by using 2.1. Denote K = \);K;, L = Li. 

There exists a unique matrix of nonnegative integers A = (4j1)sex with the properties. 
1°. (Axi )iex, describes the inclusion B,; < B;,,, fori 20, 2i+1<n; 


ag (Au ick: describes B,;,, < By;42,i20, 2i+2 <n; 
3°. K;, L; satisfy L; = {le L|Ake K; with a,, + 0} 

and K;41 = {ke K|ileL; with ayy + O}. 
4°. ||A|/? < [M:N] and A is irreducible iff (ay:)eko, teLo #5: 


Proof. The construction of K;, L;, K, L and (a,;),;, with 1°, 2°, follows by induction 
from 2.1. To prove 3°, let p’, p”, q’ be minimal central projections of B;,,, B,+2, 
B;_, respectively, with e;,,p’ = e;,,q' and p’p” + 0. We must show there exists 
some minimal central projection q” € B; such that e;,,p” = e;,.q" and q’q’ + 0. 
Define q” =A~'Eg,, ,(p"e:+2). Since e42B;.2@+2 = Be;+2, q" is a minimal 
central projection in B;. Also Eg,,,(p’)p’=ap' for some «+0. Thus 
qq" =47"qEz,,, (p"ei+2) so that 


P'C4199' C41 PD = A~*p'q'Ep,, (i+ 1P"Gi+ 2241) = P’q'Ex,, ,(€:+1P") 
= p'(q'e:41)Ep,, ,(p") = ap'e:4.1 ¥ 0. 


Thus q’q” + 0. 

The irreducibility condition for A follows by 3°. Moreover by 2.9 in [PiPo3] we 
have ||(dji)es«||? S$ [M:N] for all n, so that || A ||? = lim, || (aq)scx. 7 < [M:N]. 
Q.E.D. P ; 


2.3 Corollary. If {B;},>;>9 are finite dimensional subalgebras (n< 0) with 
B; c M,, for i= 0, Eg, Ey,_, = Eg,_,, for iz 1, e,€B;, for i = 2, and if there exists 
ig 2 0 such that dim 2(B;,,.) < dim Z(B;,,), then {B;},>;>;, with the projections 
e;€ B;, i = ig + 2, are obtained by iterating the basic construction starting from the 
inclusion B,,< B,,,, and at each step the unique trace t of UM, is a 
4 =[M:N]~*-Markov trace. Thus, if A = (ay) is the inclusion matrix of 
B;, < B;, 4 and (s,), are the traces of the minimal projections of B,, and (t,), those of 
B;,4 then 

1°. The inclusions B;, < B;,4, ¢ B,,42... are given by A, A’, A,... 

2°. The traces of minimal projections of B;,, 2; are given by (A/s,), and those of 
Big +2j+1 by (At). 

3°. || Al]? = [M:N] =~! and || Ao||? = [M:N] for any irreducible component 
Ao of A. 

4°. (s,), is a Perron-Frobenius eigenvector for AA' and (t,), a Perron-Frobenius 
eigenvector for A‘A. 
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Proof. Trivial by 2.1, 2.2, 1.2. Q.E.D. 


As 2.3 shows, the existence of a sequence of commuting squares satisfying 
the hypothesis of 2.3 imposes restrictions on the index of N in M: we must have 
[M:N] = ||A||?. We now deduce that we “almost must have” N’ a M = C. 


2.4 Corollary. Assume there exists a sequence of finite dimensional subalgebras 
B; < M,,i 2 0, satisfying the hypothesis of 2.3. Then Ey-.y(€9) = [M:N]~' 1 for all 
Jones projections e)€ M (i.e., projections ey for which Ey(e)) = [M:N]~'1). 


Proof. Let B,, = ®.Mn,xn,(C). Then by [PiPol] and 2.3 (see also [PiPo3]) we 
have 


ey aj (AAAI) (AM ty 
AB, +.2341|Bi+2)) = AA'yn),t,A/1 
(Bi, +2j+11Big+2,) Dut yn)’ In (AA), (Ht) 

Since (A A‘)/n tends (up to renormalization) to the Perron-Frobenius eigenvector of 
AA’, i.e. to a scalar multiple of At, it follows that 

_ (A(AA'Vii) (At), 

lim ae = 

j7o ((AA ) N)xt 








Thus, since }',, ;(a,:(AA‘)/n),t,7/ = 1, it follows that lim;..,, H(B;,+2;+1|Bi.+2;) 
=In4~'. Since M,,< M;,+;, is isomorphic to a reduction of the pair 
Mi, +2; © Mip+2j+1 by a projection in M,,,.; (cf. [PiPol]) it follows that 
A(M,, + 25+1|Mi,+2;) = H(Mi,+1|Mi,) for all j 2 0 (cf. e.g. 4.4 in [PiPol]). Thus 
from the commuting square condition we get 

A(B;, +25 +11 Bi.+2;) S H(M;, + 2;+1|Mi,+2;) = H(M;,+,|M;,) <n A} 

which shows that H(M,,.,|M;,)=In4~'. By [PiPo2] this implies H(M|N) 
= Inj~! and Ey-u(e€o) = [M:N]~'1. QED. 

If B;, i= 0, satisfy the conditions of 2.2, then e;e B; for all i = 2 implies that 
|) BY < UM? = M is a type II, von Neumann algebra (since {e;}” is a type II, 
factor). In fact |_);B}’ follows to be a factor under very general assumptions. We will 


prove this type of results elsewhere. For what we need the next easy consequence of 
2.3 will do. 





2.5 Corollary. Let {B;};>o be like in 2.3 (with n = 00), and assume the inclusion 
matrix of By < B, is irreducible. Then R = \_);By is a type Il, subfactor in 


UiM? = M. 


Proof. Let e*', f'' be the minimal central projections of B,; respectively B;, ,. 
Arguing like in 2.4 (see also [PiPo3]) it follows that 1°. lim;..,, t(e‘) = vz; 2°. 
lim;...t(f"') = w?; and 3°. lim;..,, t1(e ‘f"') = 4!/2a,,0,w,, where (v,),, (w,); are the 
Perron-Frobenius eigenvectors of AA‘, respectively A‘A normalized so 
that }',o¢ = 1, }, w? = 1, and A= ||A||~?. Let peA(Z(R)) and p,c A(Z(B,)) 
such that ||p, — p||, +0. In particular we have: 4°. || p3,Pon+1 — P2nll2 70. Let 
E, < K, F, < L with pon = Dyce, O°", Pans 1 = Der, f'””. Then 3°, 4° show that, for 
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n large enough, if e* "f"" + 0 (or equivalently a,, + 0) for some ke E,, le L, then 
le F,. Thus 


F,, = {le L|a,, + 0 for some ke E,} 


and p>,+; 2 Pon» SO in fact p>,+; = P2, again by 3°, 4°. But this contradicts the 
irreducibility of A, unless E, = K, F, = L, pz, = 1. Q.E.D. 

We will refer to the property sup dim #(B,) < oo for an increasing sequence of 
finite dimensional algebras {B,}, by saying that it has bounded (or finite) growth. 


3. Higher relative commutants and finite depth 


Approximating a pair of hyperfinite factors N < M with finite dimensional sub- 
algebras satisfying the commuting square condition (*) is in fact quite difficult. 
However, there is a simple way of producing finite dimensional subalgebras of M 
satisfying (*) by taking the relative commutants in M of some subfactors N of N. 
Indeed by [Pol] we then have Ey. .yEy = Ex.y- Also, if [N:N]< oo then 
N’ aM is finite dimensional. A possible choice for N are the factors in the tunnel. 


3.1 Proposition. Let M >°°N >°-'N, >°-?N, >... (respectively 
M <*'M, <°?M,c...) bea choice of the tunnel of factors (resp. the Jones tower). 
Then we have 

1°. Ni; M, M'o Mare finite dimensional. 

2". Ey. .MEn, = Ey any Ev. ame = Ey, ,m, fork Si Sj 


3°. €9,€-1,--+ 50-141 EN; AM, ep, €3,...,0;EM OM,. 


Proof. By [J1] N;a M, are finite dimensional and by [Pol] we have the corres- 
ponding commuting squares. Q.E.D. 
Although the tunnel of factors N, is not uniquely determined (see 1.3) the 


resulting pair of algebras (),(N;aN) < )(N;AM) is actually unique up to 
isomorphism. 





3.2 Proposition. 1°. Let M >°N >°-'N, >°-?N,2>..., 
M>®*®N >*:1N°95@2N$ >3..., be two choices of the tunnel. Denote 
R = U(Nj0M)”, Ro = UNV AN)" & R, R° = Uj(NY OM)”, 
R$ = UN’ ON)” c R®. Then there exists a trace presenting isomorphism of R 
onto R° carrying Ry onto Ro and Nj,A M onto M'A M444, j>0: 

2°. Let NC Mc“'M, cM, c... be the tower of factors and M = U,M,, 
R'=M'OM, RS=M,0M. Then there exists an  antiisomorphism 
:()(Nj;AM)>(M'AM;4,) with (N50 M)=M'AMj4,, (NON) 
=M1OMj4,, Pe-j;)=ej42. Moreover if NCM_ satisfies Ey-,y(eo) 
= [M:N]~'1 then @ is trace preserving and can be uniquely extended tx a trace 
preserving antiisomorphism of R onto R' carrying Roy onto R}. 


Proof. 1°. By [PiPo1] (see 1.3) it follows that there exist unitary elements u;e N?, 
i= 0, such that u;_, ...ugN,ué...uk_, = N92, i= 1. Define o:R > R° by a(x) 
= lim;..Uj-1 -.. Upxu§ ... ut_,. If xe N; OM, then 
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Uj, ... Ugxue ... ut_, EN?’ OM so that 
* * * * * * 
Un... Uj(Uj-1 ... UgXUh ... UP, up... UF = U4... UgXUG ... Uj-1, 


for all n > i — 1. This shows that o is a well defined trace preserving isomorphism. 
Obviously o(Ro) = R&. 

2°. By [PiPo2] one can represent recursively each M, on L?(M,1). Thus 
UM, ¢ &(L?(M,7t)) and N; = JM;,,J will form a tunnel of subfactors in M. 
Since JM’J = M we also have J(M’ 4 (\);M;))J = iN; 0 M). Thus the reflec- 
tion ®(x) = JxJ gives the desired antiisomorphism, which, in case Ey-,y(€o) = 4, is 
trace preserving by [PiPo2] and thus can be extended from | ),(N;aM)” onto 
M’aM. QED. 





3.3 Definition. The pair of algebras Ro = ()(N;QN)¢ UA(N;OM)=R is 
called the core of the inclusion N < M. Note that the isomorphism class of 
Ry < R doesn’t depend on the choice of the tunnel. 

Since the algebras M’ cq M, satisfy the conditions of 2.2. (cf. 3.1) we can now list 
the corresponding properties of these algebras: 


3.4 Corollary. Denote B? = Nj_, 0M and B; = M'M,,. Then B? satisfy condi- 
tion (*) in Section 2 and B;, i = 0, satisfy the hypothesis of 2.2 and they have the 
properties: 


3.4.1. If p;.2 is the central support of e;,, in B;,, (resp. of e_; in B?,,) then 


Bj + 2Pi+2 = span B;, e+ 2Bi +1 (resp. Bi 2Pi+2 = Span B?, ,e_;B?,,) and 
B; 4,6 *?B;42P:+2 (resp. B?,, ~ Be, .p;+2 < °~‘B?,,) is the algebraic basic con- 
struction for B; < B;,, (resp. B? < B®, ,). 


3.4.2. Identify the sets of simple summands of B,; and BS; by 3.2.2 and denote it by K;, 
i > 0, and those of B,;4,, B9;4, by L;,i = 0. Via these identifications the embeddings 
K;< K;,, (or L;< L;,,) defined in two ways by either the application 
2(B)3q gq" €2(B;+2Pi+2), with q'ei42='eji42, or by Z(B?)3q' 
q’ € F (Be, Pp; 42), with q’e_; = q’e_;, are the same. 


3.4.3. Let K = |);K;, L = \);L;. Then Ko = {ko} and there is a unique pointed 
matrix A = (dy)cx, ko € K, such that (Ai cx. describes B,,; < B,;,, and BS; < BS;,, 
while (ay, )keK+ “describes Boi41 ¢ . and B9;,, < B3;,,. Moreover K;,, L; 
satisfy es 
L, = {leL\|akeK; with a,+0}, 

K,4, = {keK|ileL; with a,+0}. 
3.4.4. A is an irreducible matrix and || A\\? < [M:N]. 
Proof. cf. 2.2 and 3.1, 3.2.2. Q.E.D. 


3.5. Remark. The pointed matrix (A,k,) associated to the sequences N; 7 M, 
M' 0M, like in 3.4 coincides with the standard matrix defined in [Po3]. It is also 
equivalent to Ocneanu’s principal graph for N’ 0 M = C. In fact for what we need 
in this section the definition and construction of A are not necessary; the result 3.8 
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which will be used in the proof of the main result in Section 4 can be derived 
directly from the general result 2.2. 

We now mention the particularization to the case B; = M’ 7 M, of the results 
on sequences of commuting squares with sup dim 2#(B;) < oo in Section 2. Follow- 
ing ({Oc]), if the sequence of higher relative commutants of N < M has bounded 
growth, then we say that N c M has finite depth. In fact this terminology is used in 
[Oc] for subfactors with N’ a M = C. We will use it here for subfactors N <c M 
without assuming the trivial relative commutant condition. We also introduce 
another terminology, which although less established seems better suited. 


3.6 Definition. The inclusion N < M has finite depth (or finite growth) if 
sup dim ¥(N;q M)( = dim 2(M’ 0 M;,,)) < © 
(i.e. if B; = M’ A M; have bounded growth). 


3.7 Corollary. If N < M has finite depth then: 
3.7.1. Ey-,m(@o) = [M:N]~* 1 and the antiisomorphism of 3.2.2 is trace preserving. 


3.7.2. There is an ig such that for all i = ip, B;, <%*?B;+2, BP, , <°~ ‘BP, are the 
basic constructions for B; < B; 4, respectively B? < B®, , and the unique trace t of M 
is a2A=[M:N]~! Markov trace on each basic construction. Thus the inclusions 
By, © Bz; +, BD; < B34, are described by A and Bz;,, < Bz:+2, Boi+1 © Bii+2 by 
A‘, for 2i = ig, A being the standard matrix defined in 3.4.3. 


3.7.3. If p (resp. q) is a minimal projection of B? or B; (resp. B?, 2; or B;+2;) which 
belongs to a simple summand labeled by the same k (if i is even) or I (if i is odd) then 
t(q) = 4’t(p). 


3.7.4. || A ||? = [M:N] and for 2i = ig the traces of the minimal projections of B,;, BS; 
give the Perron-Frobenius eigenvector for AA‘, A being the standard matrix. 


3.7.5. The algebras R = | )(N;M) and RAN, =\)(N;ON)), j 2 0, are type 
II, factors. 


Proof. By 2.3, 2.4 and 3.1, 3.2.2 we get 3.7.1-3.7.4. Moreover, by 2.5 and 
3.2 it follows that R=\|),(N;QM) is a factor. Since [M:N,;]< oo and 
Ey: .mEn, = En: N;? by [PiPo3] it follows that the embedding matrix 
of NiAN;CN;QM, i2j20, has square norm majorized by 
[M:N]/**. Thus, since supdim2(N;AM) <0, supdim2(Nj;QN,) < 
as well. Thus N;,, < N, has finite depth and RON; = (),(N{; Nj) is a factor by 
the previous part. Q.E.D. 

Corollary 3.7 yields an important property for subfactors with finite depth: 
there is a uniform bound for the local indices [pMp: Np] of the inclusions N; < M, 


independent of i and of the minimal projection p of N; 7 M. More precisely we 
have: 


3.8 Theorem. Assume N c M is a subfactor of finite depth. Let A = (44:1 sex koe K, 
be its standard matrix and let (v,),¢x be the Perron-Frobenius eigenvector of AA‘ 
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normalized so that v,, = 1. Let i = 0 and p be a minimal projection of N'5;-, © M (or 
M'c\M,,;) which belongs to a simple direct summand labeled by ke K. Then 
[pMp:N>;-1P] = vz (respectively [pM.,p: Mp] = v7). Moreover if q is a minimal 
projection in N4; M or M'aM,,;,, in the simple summand labeled by le L then 


2 
[qMq:N2:q] =[M:N]“* (aun) (respectively [qM2;+19:Mq] 


2 
= (M:nd( 5 out ) ; 


Proof. Since Ey-,y4(@o) = 4=[M:N]~', by [PiPo2] and 3.1 it is sufficient to 
prove the statement for the tower. By [PiPo2] we then have [pM,,p:Mp] 
= [M,;:M]t(p)? = 4~7't(p)?. Let jp 2 0 be so that M’ 0 M2;4, © M’OM3;,; is 
the basic construction for M’ M,; ¢ M’O M2;,, for j 2 jo. By 3.7 if j = 0 and 
if pz! is a choice of a minimal projection in the k-th summand of M’ 4 M_, then 
t(py) = 42 /°r (pe). Thus 


Cpe’M 2;pi?: Mpg’) = 2 e(py!)? = At (pp?)? 


But by 3.7 (t(pz°)),<x is the Perron-Frobenius eigenvector for AA‘ normalized by 
t (pg?) = A. Thus [pgiM2,pz/:Mpg/] = 1 and [pg/M.,pz/:Mpz/]'? coincides 
with the k-th entry of the Perron-Frobenius eigenvector of AA‘ which has the ky 
entry equal to 1. 

Similarly if p7/*! is a choice of a minimal projection in the /-th summand of 
M'O M2; ,,j 2 0, then (c(p7/**)), = A‘(t(pf/*?)), and 


[pP** Mays spelt: Mppl**) = (ppt tPA- 20-1 om o(ppiet pPQ- 280m! 


Thus we get for j = jo 
A(LpP!** Maj sprl**: Mppi**}"), = 2 *7(a( De!) 
= A> *?([ pg??M 2 jp??? Mpg???) . 


This implies that 2~'/?([p?/*'M.,,,p7/*':Mp7/*"]'/?), is a Perron-Frobenius 
eigenvector for A‘A so that 


AY? AML pl? 2 joe? : Mpg???) = (Lei? * *M2j+ pr? *:Mppi**J"”), . 
This ends the proof of the theorem. Q.E.D. 


4. Finite depth and the generating property 


As we mentioned before, a general strategy for approaching index problems for 
subfactors N < M of the hyperfinite II, factor M ~ R is to approximate N < M by 
a sequence of finite dimensional subalgebras satisfying the commuting square 
condition (*). From Section 2 we saw that the finite dimensional subalgebras 
B? = Nj_, 9 Mare the first to be considered that satisfy EgoEy = Ego,y. Then the 
approximation with B? amounts to say that we may choose the tunnel N; so that 


the core Ro = (Nj; AN) < Ui(N; 0 M) = R coincides with N c M. 
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Approximating N < M with the sequence of higher relative commutants is 
more rewarding than with other finite dimensional algebras, since the sequence of 
higher relative commutants is canonical. 


4.1 Definition. We say that N c M has the generating property if there exists a 
choice of the tunnel of subfactors N; such that Ni; 01 M7 M, N; ON TN. Note that 
since Ey, .yEy = Ey, .y,N;aM1TM actually implies Ni; 0 N 7 N. 

We will prove in this section that if M is the hyperfinite II, factor and N c M 
has finite depth (i.e. supdim 2(N; 7 M) < oo) then N c M has the generating 
property. The key observation allowing us to prove this generating result is that the 
subalgebras B = N, v (Ni, M) satisfy the basic inequality E,(x) 2 cx, xeM,, 
with c independent of k. This important device will be a simple consequence of 3.8. 
But first we need a simple formula which is implicit in [PiPo3]. 


4.2 Lemma. Let no, Co < ©. If q,,...,4,€PA(M) is a partition of the unity in M, 
with n < no, and if P; < q,Mq; are subfactors with [q,;Mq;:P;] < Co, then B = );P; 
satisfies E(x) => (npCo)” 'x, xEM,. 

Proof. Denote B, = }'.q;Mq;. By [PiPo3] we have Ex, (x) = no 'x, xe M,. More- 
over if ye B,, y = Ly;, with y,eq,;Mq; then Es( y) = );Ep,(y;). Thus if y = 0 then by 
[PiPol] (see 1.1) we have E,(y) = )i[q:Mq;:P;]~'y; 2 Coy. Altogether we get 


for xe M,, Ep(x) = EgEg,(x) = Co‘ Eg,(x) 2 (Como) 'x. QED. 


4.3 Theorem. Suppose N < M has finite depth. There exists c > 0 such that given 
any choice of the tunnel of subfactors {N;};>, we have 


Ey, (Nia My) 2cx,xEM,, 
for all i= 1. 
Proof. Let {q';}; be the minimal central projections of N; a M. Then qj are also the 
minimal central projections of N; v (N; M). Thus N; v (Ni; M) = );,P; with 


; i ‘ : J 
P; =(N; v (N; 0 M))qj subfactors in q;Mq;. Moreover if p is a minimal projection 


in (Nj M)qj then pe P‘ and N;,p = p(N; v (Ni; M))p = pPip so that 
[qMqj: Pi] = [pMp:pPip] = [pMp:N,p) . 
By 3.8 there is an upper bound on this indices, 


sup{[pMp:N;p]|i20,p minimal projection in N; 1 M}=Cy<o. 


Thus [qMqj: Pi] S Cp for all i, j. Moreover, since for each i the number of P’s is 
bounded by sup dim 2%(N; 7 M) = no < ©, the statement follows by 4.2. Q.E.D. 

If c is the uniform bound (from below) given by 4.3 then the above theorem 
easily yields the existence of a tunnel N; so that R = ();(N;7 M)” has finite index 
in M. This “almost” proves the generating property. To show all this let us first 
mention a consequence of the hyperfiniteness of M and of [ J1]. 


4.4 Lemma. Let NcM be hyperfinite II, factors with finite index. Let 
M >°N >°"'N, 3°27... 2***!N;_, D> N; be a choice of the tunnel up to some i. 
Let e>0 and FO N;v (N;QM) a finite set. Then there exists j2i and a 
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continuation of the tunnel >°-'N; >°-'-'Nj,4...>° 4*1Nj;_, > Nj such that 
xE.Nj OM, xeF. 


Proof. Let { f? .},.5., be * matrix unit for N; © M, where n labels the summands of 
N; OM. Then x = 2x?, f7,, with x?,e N;. Since N; is isomorphic to the hyperfinite 
II, factor (cf. [C]), by [J1] we may ‘regeed it as generated by a sequence of 
projections {é),},>, ¢ N; satisfying Jones’ axioms ¢),€m+ 1m = A€ns [en &,.] = 0 
for |m — n| = 2, t(e’,) = A, where 4 = [M:N]~'. Thus for any 6 > 0 there is p = 1 
such that x",e,Alg{l,e,, ..., ep-,}. Let >@iN,; >“i-1N9,,... aei-ves 
N?s»-1 > N?,, be a continuation of the tunnel up to i + p. By [J1] there is a t- 
preserving isomorphism between Alg {1, e;,..., e,-,} and 
Alg{1,e°;-,,...,@°;-p+1} sending e, to e° ;_,. Thus there is a unitary element in 
the ambient algebra N; such that ue® ;_,u* = e,, 1 < k < p — 1. Thus, if we put j 

=i+pandN,,, =uN?,,u*, 1 <k < p, then N,,, is a continuation of the tunnel 
such that Nj; M > Alg{l,e},..., e)-1}35x?, for all n, r, s (and all xe F). Since 
fis€ N;QOMCN5OM and xf,€;Nj;0M, if we take 6 small enough we get 
Ni OM3,2x%, firs = X, XEF. QED. 


4.5 Corollary. If N < M has finite depth and N, M are hyperfinite I1, factors then 


there is a choice of the tunnel {N;};>, such that the factor R = \_),(Nj,q My) has finite 
index in M. 


Proof. Let c > 0 be the constant in 4.3. Let {x,}, < M4, be a sequence of elements 
dense in the unit ball of M, in the norm || ||,. By 4.3, 4.4 we may choose 
recursively numbers k, < k, <...<k,_, <k,...and continuations of the tun- 
nel N,_,41>--- > N,, such that Ey. am > = in || X;|13, 1 Si <n. Indeed, 


def 
suppose we achieved step n — 1. By 4.3 we have y,=Ey yw, jmy(%i) 2 CX: 


thus || y;||3 = t(y,x;) 2 ct(x?) = cl] x; 3, 1<isn. By 4.4 we may choose 
Ny, -1+1 > Nin-1+2+++> Ny,» for some k, > k,-,, 80 that y; €1),N;,,.0M. Thus, 
since Ni, M and N,,_, v (N;,,_, 0M) form a commuting square (cf. [Po1]), we 
get || Ey. vm (i) I3 2 |l Ey, v (Ni, 0M) Ey, xm) ll2 
= || Ey. a MEn,., Vv (Ni. mye I cag 1inll Ey, ¥ (i, amy%i) ll 2 c¢||x; II3. 
If we take now R= Une 1(Ni, 0M)” = Ure 1(NioM) then || Eg(x;)||3 
= lim, || Ey. am (% ) 13 = c|lx;||3 for all i. Thus || Ep(x)||3_ = cli x||3 for allxeM,, 
by density. Since R is a factor (cf. 3.7.5), by theorem 2.2 in [PiPol] we get 
[M:R] sc. QED. 

We now show that if we can choose the tunnel N; so that [M:R] < oo, with 
R = ()(Ni- M), then we can actually choose it so that R = M. We will prove this 
by contradiction. So we need to know what the failure of the generating property 
implies. 





4.6 Lemma. Let N c M be so that there exists a choice of the tunnel N;, i = 1, with 
the property that R = \_);(N;M) has finite index in M. Assume N < M doesn’t 
have the generating property. Then we have 

(1) Ve>0, Wky 21, 3k; >ko, JxeM, ||x],=1, |x] S$ [M:R]'? such that 
I E,, rut(X) Ilo S S ¢, Vu, €U(N,,). 
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Proof. Note first that the property (non 1) reads: 
(Non 1) “Jé) > 0, dkg = 1 such that Vk > ky, VxeEM with ||x||, = 1, 
|x| < [M:R]'/?, Jue W(N,) such that || E,p,«(x)ll2 > €” - 
Assume (Non 1), instead of (1), holds true. Let then {x,}, < M be a sequence of 
elements satisfying || x, ||, = 1, || x, || < [M:R]'/?, dense in the norm || ||, in the set 
{xeM|||x||, = 1, ||x|] S$ [M:R]"/?}. Let also {y,}, ¢ M, be a sequence of ele- 


ments dense in the norm || ||, in M,. We will find recursively 1 < ky < k, < 
and a choice N?, i = 1, of the tunnel such that 


(i) I Eno’, m(%n) ll 2 &o; 
(ii) Il Eyer ym (Ya) lI = 1mLM:R]* lyn ll3; 


Suppose k, <k,<...<k,-, and M>NO>N25D...>NP_, have been 
chosen. Let uy¢@%(N) be such that up N?ut = N; fori=1,...,k,-,. Then 


ER(UoYnto) 2 [M:R]~‘uoy,us ’ 


so that there exists k° > k,_,, k° > ko such that: 


Enjon mM UoYntto) 2 tmLM:R] ‘ugyud : 


Thus we get 


Eve Nyous aM(Ya) = E,sinjo A Muy Yn) 
~ WOE yo Mond Mo 2 imLM:R]"*y,« 
Moreover, by (Non 1) applied to x = upx,uG, there exists u, €@(N,0) such that 


| E., RutUoXn Ug) \|2 > & - 


But then, again by the definition of R, there exists k, > k® with: 


| E, (Ni. > Mut UoXn US) \|2 > Ep - 
Thus we also get: 


HE gu, N uty Mn) lla = Il Evgu, (vi, Myutug(Xn) lla > €0 - 


But ugu, Nut uo = NP, for 1 Si <k,_,, so that if we put NP = ugu,N jutuy for 
k,-1 <j £k, then both (i) and (ii) will be satisfied (also, since ugu, N,oufuo 
= ug Noto). “This ends the proof of the existence of N?. 

Let R° = (),(N?’ 0 M). Then by (ii), |Ego(y) It 2[M:R]~* |lyll3, yeM,, so 
that [M:R°] <[M:R]. Since R° + M, [M:R°]= 2 so by [PiPol] there exists 
meéM with im |, = 1, ||m|| < [M:R]'? such that Epo(m) = 0. But (i) shows that 
|| Epo(m) ||, 2 &), a contradiction. Q.E.D. 


4.7 Corollary. Let w be a free ultrafilter on N. With the notations and under the 
hypothesis of 4.6, there exist x = (x,),€M®, ||x||, = 1, ||x|| < [M:R]'”, and there 
exists ky <k,<... such that x LuR®u* for all unitary elements u in | |n+oNj,.- 
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Proof. The construction of x, follows by applying recursively 4.6. Q.E.D. 


It turns out that if By), B < M are von Neumann subalgebras of M then the 
span of uBu* for u running in Y(B,) is almost a By — By bimodule. We will prove 
this technical result in the next section (see 5.1). Thus we get from 4.7: 


4.8 Corollary. With the notations and under the assumptions of 4.6, 4.7, there exists 
x € M®, ||x||, = 1 such that x L([]oN;,)R°(] JoNx.,)- 


Proof. By 4.7 there exists xe M®, ||x||, = 1, with 


def 
xLX = span uR*u*\ue([] M)} 


Also, by 4.4 we have [].,(N,, v (Ni, M)) < X. Indeed, if 
VY =(Va)nE] Lo(Na, V (Ni, 0 M)) then by 4.4 for each n there is a w,€%(N,,,) and 
1, > k, such that 


Yn €©1jnWa( Ni, © M)we c w,Rwp . 


Thus yewR°w* c X, where w=(w,),. Thus 5.1 applies and we get 
xL([]oM.JR°(U[oN:,)- Q-E.D. 

We can now end up the proof of the generating result. 
4.9 Theorem. Let M be the hyperfinite Il, factor and N < M a subfactor of finite 
index. If N has finite depth (i.e. sup dim 2(M’ q M;) < © for the Jones tower M;) 
then N <M has the generating property (i.e. there exists a choice of the tunnel 


N,, i = 1, so that \_);(N;q M) = M). Moreover, if M = \_);M; then there is an anti- 
isomorphism of M onto M' a M carrying N onto M', 0 M. 


Proof. Assume N < M doesn’t have the generating property. By 4.5 and 4.8 there 
exists xe M®, x +0, xLspan([]N;,)R°([ ]o Nz), Where N; is a choice of the 
tunnel such that R = U(N;A M) satisfies [M:R] < ©. 


Since EpEy, = Egnn,s [R:N;O R] S$ [M:N;] (cf. e.g. [Po2]). Moreover, since 
R contains the Jones projections in the tunnel, eg, e_,, e_>,..., it follows by 
[PiPo2] that R contains the Jones projection for N; < M, i.e. a projection fe M 
with 


Ey(f)=(M:N]"'1. 


Thus fe R, Ey, .2(f) = Ey,(f) = [M:N;]~ ‘1, so that [R:N;0 R] = [M:N,]. Al- 
together [M:N;] = [R:N; R]. But 

(cf. [J1]) so that [M:R] = [N;:N,- R]. It follows that if {mj}; is an orthonormal 
basis of N; over N; R, then it is also an orthonormal basis of M over R, thus 
> miR = M. Put m, = (m'), € M°. It follows that }\;m;R° = M°. But x L}’;m;R°, 
a contradiction. 


The rest follows by 3.2. Q.E.D. 
Note that we also proved the following general result: 
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4.10 Theorem. If N < M are hyperfinite factors with finite index and if there is a 


choice of the tunnel N, such that R=\),(N,jM) is a factor and satisfies 
Ep(x) = cx, for all xe M* and some c > 0, then N < M has the generating property. 


Proof. By the duality result 1.5 in [PiPo1] it follows that if U(N, © M)” is a factor 
then U(N,N,)” is also a factor, and more generally (NiO Noi+1)” are all 
factors for i= 0. Moreover since U(N4;4,; AM)” = U(N, 0M)”, it follows that 
N CM has the generating property iff N, < M has the generating property. 
Altogether this shows that in the above statement we may assume 
R; = U(N,A M)” ON, = AN, N;)” are all factors. But then the proof of 4.9 
shows that N c M has the generating property. Q.E.D. 








5. Proof of the linearization principle 


We prove here the linearization principle that we used in the proof of Theorem 4.9. 
The essence of this linearization principle is the noncommutative Rohlin type 
theorem in [P04]. 


5.1 Theorem. Let M be a finite von Neumann algebra with a finite faithful trace t. 
Let B< M be a von Neumann subalgebra and S < M a vector subspace. Then 


(span {uSu*|ue%(B)} + B v B’AM) =(spanBSB+ Bv B’nM) , 
the closures being taken in L?(M, 7). 


Proof. We clearly have the inclusion <. Let €€L?(M,1) with <uyu*, €> = 0, 
<b,€> =0 for all ue%(B), yeS, beBv BAM. Let heB,, iSign. Pur 
f:-C'oC, 


fi, Ar, bia An) = <exp(A,h, )exp(Azh2) “es exp(/,h,)y exp( as Anhn) 
...exp(—A,h,), &>. 


Then f is analytic on C" and vanishes on (iR)". Thus f vanishes everywhere on C”. 
Since any invertible element in B is a product of two elements of the form exp(Ah), 
with A € C, he B,, we obtain that <sys~', €> = 0, for any yeS and any invertible 
element s in B. Let p1q be projections in B and sé B invertible. Denote s,(t) = 
tp + (1 — p), s(t) = «(1 — q) + q. Observe that s,(t)~' = s,(t~*), s,(t~') = s,(t~') 
and that 


ms o 
tims Zz $2 (Hs, (sys *s,(t)~*s,(t)~' — psys~'q} = 0. 


It follows that <psys~ ‘gq, €> = 0. We now deduce that <zyz*, €> = 0 for all ze B. 
It is clearly sufficient to prove this when spec(z*z) is finite. So let z = au, where 
a= La,e;, with a; = 0, Le; = 1, e,¢ A(B), and ue W(B). By [Po4] there is a refine- 
ment f,€ B of the e;’s so that 


| LIES — &5, 5080 my (5) 


2 
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is small (the result in [Po4] is stated for B’ ~ M c B but the general case used here 
has exactly the same proof). But since }';f(B’ 0 M) < B v B’OM and épyg-,y(€) 
= 'Q; CS rB A m)(S) = 0 as well. This shows that we can make || VHth ||, as small as 
we please, with f;¢ A(B) refining the e;’s. 
Since < fuyu*f;, ¢> = 0, for i + j, it follows that 


<zyz*, €> = Cauyu*a, €> = (Ssauyutaf ‘) 


= ( auyuta DE ) = ( yet, Dh ) : 
J J 
By the Cauchy-Schwartz inequality 
<zyz*, >| S lzyz* la | GEG 
J 2 


and for fixed z, y we can make this last term as small as we want. This shows that 
«zyz*,€> =0,zeB,yeS. 


The standard polarization trick then implies: {z,yz,, €> = 0, for all z,, z,¢B, 
yeS. QED. 


6. Applications to the classification of subfactors 


The generating type results redyce the classification (up to conjugacy) of the 
subfactors of the hyperfinite II, factor to the classification (up to trace preserving 
isomorphism) of the corresponding sequences of inclusions {N; a N < N;q M}; 
(or {M1 M; < M’OM,;};). Moreover under the finite depth assumption all the 
information on such a sequence is contained in an initial commuting square: 


Ni, 0 M ¢ Ni+i OM, 
U U 
Ni, ON ¢ Nas WR, 
where ig, the inclusions, the dimensions and the traces are all determined by the 
standard matrices of N < M and N, CN. To deduce this we return to the general 
setting of Section 2. 


The next result was first noted by Jones and by Pimsner-Popa, independently 
(CL JPP]). 


6.1 Lemma. Let 
Bo <4 B, 
Cu Uu D 
Bo <p, Bi 


be a commuting square of finite dimensional algebras with the matrices A, B, C, D 
describing the corresponding inclusions. Assume By < B,, Bj < B} satisfy the equi- 
valent conditions of 1.2.2 and || A|| = || B\|. If By c B, <?B, <°B,c... is the 
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iterated basic construction for By < B,, t is the 4 = || A||~?-Markov trace on u B; 
and if we denote B}, , = span B}e;,,B}, i= 1, theneB}, , has support one in B;, ,, 
Bic Bi cB} oc 8Bi Cc... give the iterated basic construction for Bj < Bi, t 
is a A = ||B\|~?-Markov trace on UB} and we have the sequence of commuting 
squares 


e2 e2 
Bo <4 By C% By <G Bz 
U U U U 
B} c B} ce B} oc 83 B} c 
0 B 1 Bt 2 B 3 


Moreover, with the usual identifications of the centers of B;, respectively B}, with 
the sets of indices of the matrices A, respectively B, the inclusion matrix for B}; < B; 
is C and that of B}3;,, < B;4, is D,i 2 0, that is, in Wenzl’s terminology ({W]), the 
sequence of commuting squares is periodic with period two. 


Proof. Let Bic B1 cB} be the basic construction for B} cB! with a 
4 = ||B||~?-Markov trace t, on B} satisfying t, (@,x) = At(x), x € B}, where t is the 
Markov trace on B, (restricted to B!). Define an isomorphism o from B} onto B} 
by o(2xé,y) = Yxe,y. Since t, °06 = t and 1,(1) = 1 it follows that t,(o(1)) = 1 so 
that o(1) = 1 and thus B} has support 1 in B,. 

To show that the inclusion matrix for B} < B, is the same as for B} < B, note 
that e, €((B})’ 0 B,) and e, €((B})’ 7 Bo)’. Note also that, since e, has support 1 in 
B}, the map (B3)' (0 B,3z++ze, is an isomorphism and that (Bj) 0 By 3z+ ze; is 
an isomorphism as well. Since 


e,((B3) A Bz)e, = (€2B3e2) A e2B ze. = (Boe2)’ A Boe2 = ((Bo)' 0 Bo)eo 


it follows that there is a unique isomorphism @:(B})’ \ B, > (B}) 0 By determined 
by ~(z)e, = ze,. But this isomorphism, when restricted to ¥(B,), 2(B}), gives the 
usual identifications between 2(B,) and 2(Bo), respectively #(B}) and #(B3). 
Moreover the dimensions of ((B})’ 4 B,)q'q" for minimal projections q’ in 2(B,), 
q’ in (B}), give the multiplicities in the inclusion matrix of B} < B,, which will 
therefore coincide with that of B} < By. Q.E.D. 

The next result will not be used here but it may be useful for constructing 
examples of subfactors. Related results on periodic sequences of commuting 
squares can be found in [W]. 


6.2 Corollary. Let 
Bo Ca B, 
Cw u D 
Bo <p, Bj 
be like in 6.1 and let 
Bo o% B, o% By c 
U U U 


BS <i BL c¥ BS c 
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be the corresponding iterated sequence of commuting squares. Let M = UB, ish 
N = \),Bn”. Then 

1°. M is a factor iff A is irreducible 

2°. N is a factor iff B is irreducible 

3°. If N, M are factors then 


(a) [M:N] = ||C||? = ||D|? 
(b) H(M|N)=I1n[M:N] so that Ey. .y(@o)EC for the Jones projection 
eo EM. 


Proof. 1°, 2° follow by Section 2 and 3° (a) is a particular case of 1.5 in [W]. Then 
3°, (b) follows by [PiPol] and, again, by [W]. Q.E.D. 


6.3 Lemma. If N < M has finite depth then N; < N;_, and M;_, < M,; have finite 
depth for all i = 1. Moreover the standard matrices for N3;4, < N>;, M2; < Mo+, 
coincide with that of N,<N and the standard matrices of N,;< N>;-;, 
M3;-, < M>; coincide with that of N < M. 


Proof. If C; is the matrix of the inclusion Nj 0 N < N; 0 M then by 2.9 in [PiPo3] 
we have ||C,;|?7<[M:N]. Since supdim%(N;AM)< oo it follows that 
sup dim #(N; 0 N) < oo. Thus N, < N has finite depth. The rest follows by 1.8 in 
[PiPol]. Q.E.D. 

The previous lemma and 6.1 show that in the finite depth case the sequence of 
commuting squares 


M’OM);,, © M'AM2i,4; © M'AM),42 ¢ .--- 
U U U 
, / , 

M19 Maig © My A Mains © Mi OMaig+2 © --- 


for ig large enough comes by iterating the basic construction for the first com- 
muting square, like in 6.1. The next result clarifies what are the inclusion matrices. 


6.4 Lemma. Assume NM _ has finite depth and let A= (dye, ko€K, 
A'= (Qq111 een, kieK', be the standard matrices of N< M respectively M c M,. 
Let M, be the Jones’ tower of factors and ig = card K, card L' + 1. Then the 
commuting square 

M’'OMz;, [4 M'AMyig+1 

U U 

M; 0 M3, aut M; O M3in+1 
has the corresponding inclusion matrices and satisfies the conditions of 6.1. Moreover 
there are trace preserving isomorphisms between the pairs M‘, \ M3;, < M' A M3,, 
and M' M);,-; < M’A M2, and respectively M, A M2;,+; © M’AM>;,+; and 
M40 Mpi,41 © Mi OM3;,4+2- Via these identifications the inclusion matrices for 
M4, M);, < M'AM2;,, and M',0M)i,4; ¢ M'OM)i,+1, in the commuting 
square, are A‘ respectively A’, in particular card L = card L’. 


Proof. The first part is clear by 6.3. The last part follows by observing that if J,,, 
Ji,+1 are the canonical conjugations in L?(M,,, t) respectively L?(M,,,,, 7) then 
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Ji,(M’ (a) M>;,) Jin = M' (a) Maio Ji,(M 4 ia) M3i,) Jic = M' (a) M)i,-1 and 
Jig + (M40 Main 41) Jig 41 = M10 Main+1, Jig 1 (MO Main +1) Jig +1 
= M0 M),,+2- But by 6.3, 3.2, the corresponding applications J;,°Jj,, Jig+1Jio +1 


are trace preserving. Since the algebras are finite dimensional it follows that there 
exist the required trace preserving isomorphisms as well. Q.E.D. 


We mention that the use of the reflections J;-J; as antiautomorphisms of 
M' a M,, was discovered by M. Pimsner and the author and, independently, by 
Ocneanu ([Oc]). Moreover in ([Oc]) the reflections and the commuting square 
conditions are suitably used to give a complete intrinsic description of the sequence 
{M,AM;¢ M'aM;}. 


6.5 Definition. If N < M has finite depth and A = (4a,,)ex, is its standard matrix 
and if i) = max {card K, card L + 1} then 


M’OM2,, © M'AMyaig+1 
U U 
, 
M,9M);,, © Mi OMpoio+1 


is called the canonical commuting square associated with N c M. 
We say that two commuting squares 


0 0 
Bor © By 
U U 
1 1 
Bo, © Bij 
i = 1, 2, are isomorphic iff there is a trace preserving isomorphism of B®, onto B®, 
carrying Bj, onto Bj, i, j = 0, 1. 


We can now derive the classification result for subfactors, in terms of classifi- 
cation of their canonical commuting squares. 


6.6 Theorem. Let N < M, N° < M° be pairs of hyperfinite type Il, factors with 
finite depth. Then N < M and N° < M° are isomorphic iff their associated canonical 
commuting squares are isomorphic. Thus, the subfactors of finite depth of the 


hyperfinite type II, factor are completely classified by their canonical commuting 
squares. 


Proof. If the commuting squares are isomorphic then their corresponding iterated 
sequences will be isomorphic by 6.1, i. there will be a trace preserving 
+-isomorphism of U(M'M,) onto |),(M° My) carrying M’oM, onto 
M”~M%, MiaM, onto M%AM*2. Taking My = U(M’AM,)”, No 
= U(M,oM,)”, M§ = (),(M° 0 Me)”, N8 = ,(M?’ 9 MQ)”, it follows that 
No < Mg is isomorphic to N§ < M8. By Theorem 4.9 it follows that N c M is 
isomorphic to N° < M°. The converse implication is trivial. Q.E.D. 








As the previous theorem shows, classifying the subfactors of finite depth 
amounts to the investigation of the corresponding commuting squares. By 6.4 the 
algebras, the traces and the horizontal inclusions involved are completely deter- 
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mined by the standard (pointed!) matrices of N < M, Mc M,. Moreover the 
vertical inclusions are determined by the same matrices up to some possible 
permutations of the sets of indices. These matrices and the permutations must 
satisfy some very strong conditions of matching the traces and the dimensions: for 
instance by 6.4 the Perron Frobenius eigenvectors of A'A and A''A' must coincide 
(via the identification of L, L' resulting from 6.4). Also the dimensions should 
satisfy A(A!)(A'A1)— 13 = (AA')'vg, where v9 = (Sxox)es 05 = (se dys and 
A = (Gy nex, With Gy = Ay, iw — | being the identification of L with L' given by 6.4. 

In many situations these conditions impose A' = A. This can be easily seen for 
|| A ||? = [M:N] < 4, where one has to analyse only the matrices coming from the 
Dynkin diagrams A,, D,, Es, E, Eg and in fact even for || A |? <2 + ./5. Then 
direct simple computations can be used to deduce that if 


Bo <4 B; 


Au UA 
gc FF 
At 


is a commuting square with A = A,, D,, E,, E;, Eg then there will be no small 
perturbations of B? to still satisfy the commuting square condition with By, Be, 
unless it is of the form vwB{w*v* for some unitary elements we By, ve BB 0 B,, 
with wB$w* = B93. Thus the number of commuting squares in 6.5 with given 
matrices is bounded. But if [M:N] < 4then N c M automatically has finite depth 
and N’~M=C (as first noted by Jones). Indeed if [M:N]<4 and 
NcMc"'M, <?M,c... is the Jones’ tower then e, ve, v... ve, = 1 (ef. 
[J1]) so Algf{e,,...,e,-,}e, Algf{e,,...,e,-,} has support 1. Thus 
N'’AM,-1e,N’ OAM,-_, has support 1 so N c M has finite depth by Section 3. 
Thus Theorem 6.6 completely classifies the subfactors of index less than 4 in terms 
of their associated commuting squares, coming from their higher relative com- 
mutants picture, which in turn, by the above discussion, are finite in number. In 
fact, in case || A||? < 4, the above observation on the combinatorial problem of 
estimating the number of canonical commuting squares is superceded by the 
complete list of such objects corresponding to indices less than 4 announced in 
[Oc]. We use in the next corollary only the finiteness of the number of canonical 
commuting squares of small indices resulting from the above remarks, without 
however giving further details on the proof. 


6.7 Corollary. Up to conjugacy, there are only finitely many subfactors N of index 


4cos? = in the hyperfinite Il, factor M, for each n= 3, and all have finite depth. 


Moreover if the subfactor N has only the Jones projections e,,...,¢, in its 
relative commutant in M,, then N < M coincides with the Jones’ subfactor of index 


tt 
4cos? —. 
n 
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Note that the last part of the corollary is just a simple consequence 


of 4.9 and of Jones’ result ([J1]) that if [M:N] = 4cos? = and N’OM, = 
n 
Alg{e,, ..., e,} then N’O M, = Alg{e,,..., e} for all k. Thus M, A Mc 


his. Geer ee : Agen ; ™ ie 
M'AM coincides with the Jones’ pair of factors of index 4cos?— which is 
n 


antiisomorphic to itself and thus it is isomorphic to N c M by 4.9. 

We mention that one can prove under very general assumptions that the 
commuting square problem has only finitely many solutions (up to isomorphism), 
when the dimensions of the algebras involved are fixed. 


As concerning the index > 4, the case <2 + J5 is still tractable, since the 
matrices of such small norm can actually be computed. One can show for instance 
that only finitely many of them may produce commuting squares like in 6.4. A first 
result of this type was proved by M. Pimsner and the author (1983 unpublished) for 
finite matrices tending to the infinite matrix: 


In fact to show this it is sufficient to consider the infinite matrix itself describing 
the matricial inclusion of type II, algebras with atomic centers like in [PiPo3], 
where the problem becomes quite easy. The same arguments can be used to settle 
the case of the other infinite matrices (and thus accumulation points) of square 
norm less than 2 + fs. 

This shows that there can be only finitely many subfactors of finite depth and 
index between 4 and 2 + J5 in the hyperfinite II, factor. Note however that 


although by [PiPol] subfactors of index <2+ a satisfying Ey-.y(e@o)EC 
automatically satisfy N’ 7 M = C, the finite depth condition doesn’t follow auto- 
matically. 
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§1. Introduction and main results 


A smooth manifold M is called CR if there exists a subbundle W of CTM, the 
complexified tangent bundle of M, such that 


VAV=0 and [Y,V]cY. (1.1) 


A function or distribution on M is called CR if it is annihilated by all the sections of 
VY. If dimgpM = 2n+1 and dimcVY =n then we say that M is of CR dimension n 
and CR codimension I. 

If (M, V) is a CR manifold then N is called a CR submanifold of M (of the same 
CR dimension) if N is a submanifold of M satisfying 


V\yCCTN . (1.2) 
Note that it follows from (1.1) and (1.2) that 

2dimcV < dimgN < dimgM , (1.3) 

and M and N have the same CR dimension. In what follows it will be understood 


that by a CR submanifold of M we will mean that (1.2) is satisfied. 
We introduce the foliowing definition. 


Definition. If M is a CR manifold then M is minimal at mye M if there is no CR 
submanifold N containing my with dimgN < dimgM. 


The importance of this notion of minimality was introduced by Tumanov [14], 
who showed that if M is a generic embedded submanifold of C” *' and my€ M then 
if M is minimal at my every CR function on M, defined in a neighborhood of 
Mo, is the boundary value of a holomorphic function in an open wedge of C"*! 
of edge M. 

It is easy to see that if M is of finite type in the sense of Bloom-Graham [6] then 
M is minimal at mo. Indeed finite type means that the Lie algebra of the sections of 


* Supported by NSF Grant DMS 8901268 





46 M.S. Baouendi and L. Preiss Rothschild 


V and their conjugates span the complexified tangent space at mo. If these are also 
tangent to N then the germs of N and M are the same at mo. If (M, W) is real 
analytic then minimal implies finite type; indeed, if M is not of finite type, then the 
Nagano leaf [9] passing through my) would be a proper real analytic CR sub- 
manifold, contradicting minimality. If M is only smooth, it could be minimal 
without being of finite type. 

The main result of this paper is to prove that Tumanov’s minimality condition 
is also necessary for holomorphic extendability. Recall that a CR manifold M of 
CR dimension n and CR codimension | is locally embeddable if in a neighborhood 
of every point there exist n + | smooth CR functions with linearly independent 
differentials. 


Theorem 1. Let M be a locally embeddable CR manifold which is not minimal 
at mo€M and N a CR submanifold of M containing mo, with dimgpN < dimpM. 
Then there exists a CR distribution T defined in a neighborhood U of mo with 
supp T= NOU. 


A slightly more general version of Theorem 1 is given in §6 as Theorem 4. 

A submanifold M of C"*! of dimension 2n + | is called generic if it is locally 
defined, near mye M, by p;=0, j=1, ..., 1, where the p; are smooth, real 
functions such that their complex differentials dp; are linearly independent. Such a 
manifold M equipped with ¥, the induced tangential Cauchy-Riemann bundle of 
C"*! is a CR manifold of CR dimension n and CR codimension 1. 

Recall that a wedge of edge M is an open set of C"*! of the form 


W (0, T)={ZeEO, p(Z)eT}, 
where 0 is a sufficiently small open neighborhood of my in C"*', Tan open cone of 


R’, and p = (p,,..., p;) where the p, are the defining functions of M near my as 
above. We can now state our nonextendability result. 


Theorem 2. If M is an embedded generic CR manifold which is not minimal at my then 
there is a smooth CR function defined in a neighborhood of my which does not extend 
holomorphically to any wedge with edge U, where U is a neighborhood of my in M. 


Combining Theorem 2 with the sufficient condition of Tumanov we obtain the 
following. 


Corollary 1. If M is an embedded generic CR manifold and my € M, then every germ 
of a CR function at my extends holomorphically to a wedge of edge M if and only if M 
is minimal at mg. 


The following result shows uniqueness of a CR submanifold of minimal 
dimension and gives two intrinsic characterizations of such a submanifold. 


Theorem 3. If M is a generic CR manifold and my € M, there is a unique germ No of a 
CR submanifold contained in M, mo€ No, of minimal dimension. Also No may be 
described as follows. 

(i) For every sufficiently small neighborhood U of mg in M, there is a neighbor- 
hood U' < U such that Ng OU’ consists of all points me U’ which can be reached 
from mg by a finite sequence of integral curves contained in U of sections of ReV. 





C-R functions on manifolds of higher codimension 47 


(ii) For every sufficiently small neighborhood U of mg in M, there is a neighbor- 
hood U' < U such that Ny OU’ is the union of sets of the form Z(bD), where D is the 
unit disc in C and Z: D-+C"*! is continuous, holomorphic in D and satisfying 
myéZ(bD) < UN M. 


We note that the uniqueness of Noy and its characterization given by (i) in 
Theorem 3 hold even in the case of a nonembeddable CR manifold. 

The study of extendability of CR functions began with the celebrated paper of 
Hans Lewy [8] in the ’50’s in which he showed extendability to one side from a 
strictly pseudoconvex hypersurface. Other sufficient conditions were subsequently 
obtained by a number of mathematicians. Recently, a necessary and sufficient 
condition for every CR function to extend to at least one side of a hypersurface of 
class C? was obtained by Trépreau [12]. The authors obtained some sufficient 
conditions [2] for extendability in the higher codimension case; these results have 
been generalized by Tumanov, as explained above. They also obtained in the real 
analytic case (loc. cit.) necessary conditions, i.e. that M must be of finite type, in 
order that extendability to a wedge hold. Since Tumanov proved that finite type is 
also sufficient for extendability, the case of real analytic generic manifolds was 
completed by Tumanov’s work. Our Theorem 2 above now settles the smooth case. 

Singular solutions for real analytic vector fields supported on submanifolds 
were constructed by Zachmanoglou [15] in the study of analytic hypoellipticity 
and propagation of zeroes. Our solutions in Theorem | have the same general form 
as his, but in our case the vector fields are not real analytic. 

We would like to thank Jean-Marie Trépreau for several interesting con- 
versations and, in particular, for suggesting to us the formulation of Theorem 3, 
and the use of Sussmann’s work [11] in its proof. 


§2. Local coordinates 


We assume here that M is an embedded generic CR manifold which is not minimal 
and N a CR submanifold of M passing through mo. We first introduce local 
coordinates around my which will be used in the proof of Theorem 1. Assume that 
dimgM = 2n+/, dimgN = 2n+1/, and dimc¥V =n, (2.1) 
with 0 <1, <1. 
We may choose a local embedding so that M is parametrized in C" *', where the 
coordinates are denoted by z = (z,,..., Z,), W=(W,,..., W,), by 


Imw; = $,(z,Z,s), 1Sj<Sl s=Rew, $(0) = dg(0)=0. (2.2) 


A basis of CR vector fields L;, j = 1,..., , can then be written in the form 


0 0 
L,=— x (2, 2, S)\— , 2.3 
j az, * ae z V5, (2.3) 
Assume that N is given by p,(z, z, s) = 0, 1 <j <1,, where 1, = 1 — 1, and the 
differentials dp; are linearly independent. Since the L; are tangent to N, we must 
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have Lp, = 0 on N, and he jP; = 90n N, since the p; are real valued. Hence, by (2.3), 


se 7, = £0; (0) = 0. We conclude that rank ( 27/0) = |,. After a linear 
oy Vx Os, isjsl, 


I<ksl 
aie of variables and using the implicit function theorem, we can assume that N 
is given as a subset of M by 


51,45 = (2, Zs Ses sis oy Bagh 1 sjsl., y (0) = dy (0) =0. (2.4) 
Put t; = 5,4; —W,(z, Zz, 8), j=1,...,1,, and take for coordinates on M, 
iS OED Bays «+ x Bags bans» 5 ty).- 
In these coordinates the L; become 


0 0 0 
L,== ne te 2 
J 02; +y Bu = as, + 2h b Like k at, ( ) 
1 < r < lL, 
where B;, and j1;,, are functions of (x, y, s, t). We introduce the vector fields L? 
obtained from L,; by setting t = 0: 


L} = = +y Bi(x, y; S, re (2.6) 


The L} form a basis of the sections of the CR bundle restricted to N. We set 


f, = 8; + id, (z, £, s, t + W(x, ys S)), 1 sjsl, ’ 


o rs 2 : a 
gj =t, + U,(z, Z, S) + ib; +1, (2, Z, s,t + w(z, Z, S)), 1 SjS1, ( ) 


where the ¢; are given by (2.2) and y/; by (2.4). Note that we have L; f, = Ljg, = 0. 
For a smooth function h(x, y, s, t) we write 


12 
h(x, y, 8, t) = h(x, y, s) + ¥ h*(x, y, s)t, + O(|t|?) . 


Since L;f, = 0 we conclude that L?f? =0, 1 <j<n,1<k <1,. As in [3] we 


define 1, vector fields R; of the form R; = a. 1 A(X, Y, = satisfying the 
k 


following relations: 
[L?, R;] = 0, [R;, R,] = 9, Rf? =&,, (2.8) 
where ¢,, is the Kronecker symbol. It follows from (2.7) and (2.8) that we have 


0 
fee 
+ 02; k 


Since the R, are linear independent we obtain, for j = 1,..., n, 


Y f&,Re- 29) 
=1 


ra] 

are s. ah 
L,=L; + Y AinptiRy + >. Hjnr tk > * 
i<sksl, 1sksl, r 
Ispsl, Isrsl, 
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§3. Construction of singular solutions. Proof of Theorem 1 


We shall use the coordinates (x, y, s, t) introduced in §2 and take a basis for the 
sections of Y of the form (2.10). We shall construct a distribution solution T of 
the system of equations L;|T=0 of the form T= V(z,z,s) 6d(t), where 
5(t) = d(t,)®@...@ d(t,,) is the dirac measure at the origin in R? and V is a 
smooth function nonvanishing at 0. 

Using the relation 


te 8(t) = 6481 


we conclude that V must satisfy the equations 


LV-— > pd,(z,z,s)V=0, 1<j<n. 
Isrsl, 


Since V is nonvanishing, equation (3.1) is equivalent to 


Li(LogV)— > yf(z, z,s)=0. (3.2) 
lsrsl, 
Therefore, it suffices to show that }°) <,<1,H)r(z, Z, S) is in the range of L?. We 
begin with the calculation of the coefficients yi,. It follows from (2.10), that 
if L;h = 0 then 


6 
Ljh =| L} sal y a ie + yy jPaeoe, 


(3.3) 


where we have used the notation h = h° + Y) <4 <1, ht, + O(t?) as in §2. 
Setting the coefficient of t, equal to 0 in (3.3) we obtain 


ives J Baws os - epee. (3.4) 
i<psl, I<rsl, 
Taking for h the functions f,, 1 Sq S1,, defined in (2.7), and using the relations 
Ry fe = px in (2.8), we obtain, 


I<rs<l, 


In (3.4) we now replace h by g,, 1 <q <1, defined in (2.7) and 29, by its 
expression given in (3.5). We obtain 


Liggt > ( -z3r > ae +) Ry + > peg, =9. (3.6) 


lspsl, isrsl, lsrsil, 


Rewriting (3.6) by collecting the coefficients of y$,, we have 


3 the r FsRyae ) = -19gh+ SL (LOPHR,@°. 
l<srsl, 


I<psl, Ispsl, 
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Let of be the matrix (9, — Yi<p<i,fpRp9o)i <1,q<1, and D(z, Z, s) = det a. 
By Cramer’s rule applied to (3.7) we obtain 


Pe tgjsu, 1 shrek, (3.8) 


Mier = Dp’ = 


where Dj,, is the determinant of the matrix obtained by substituting the rth column 
in & by the vector (—L?gk + Yi <p<i, (LPS‘)R,9¢), 1 Sq <1,. Summing (3.8) 
over r we obtain 


y yo, =D"! = y = —L?logD. (3.9) 


I<rsi, Isr 


Here we have used the identity (L}/*)R,g¢ = L}(f4R,g?) which is a consequence 
of [L?, R,] = 0 (cf (2.8)) and L?g? = 0. 

Note that D(O) + 0. From (3.2) and (3.9) it follows that a desired solution of (3.1) 
is given by V = D~!. This completes the proof of Theorem 1. 


§4. Proof of Theorem 2 


We shall first show that the distribution solution T of Theorem 1 is not the 
boundary value of a holomorphic function in any wedge with edge M. We shall 
then use 7 to construct a CR function of class C* with the same property. We use 
the closed graph theorem, together with a result from [4] to show that there exists a 
smooth CR function which does not extend. 

We review here some basic properties of boundary values of holomorphic 
functions in wedges. If M is an embedded generic CR manifold of C"*! of 
dimension 2n +/ given by Imw = Q(z, Z,s) as in (2.2), and I an open strictly 
convex cone of R! and © an open neighborhood of 0 in C"*', we define the wedge 
W (0, T) by 


W (0, T) = {(z, we O, Imw — $(z, Z, s)eT}. (4.1) 


If h is a holomorphic function in W (0, I’) with slow growth at the edge M, i.e. 
|h(m)| < Cdist(m, M)~”, for me W (0, I), then h has a boundary value b,,h as a 
CR distribution on M 4 ©. Furthermore, if bh = 0 in an open set of Mn © and 
W (©, I’) is connected then h vanishes identically. (For a flat wedge see [7], and for 
the general case see [1] and [2].) 

We begin with the following result. 


Proposition 4.2. Under the assumptions of Theorem 2, for any k = 0 there isa CR 
function of class C* defined in a neighborhood of mo which does not extend to any 
wedge with edge M near mo. 


Proof. The fact that the distribution solution T of Theorem 1 is not the boundary 
value of a holomorphic function in any wedge with edge M is proved by the 
following lemma. 
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Lemma 4.3. Let M be an embedded generic CR manifold and S a CR distribution on 
M, nonzero in any neighborhood of mo, with the following property. For every 
neighborhood U of mo in M there is an open set U’ < U such that S vanishes in U’. 
Then in any neighborhood of mo, S is not the boundary value of a holomorphic 
function in a wedge with edge M. 


Proof. Indeed, it follows from the remarks preceding Proposition 4.2 that if S were 
the boundary value of a holomorphic function h in a connected wedge W(0, I’), 
then, since S vanishes in an open subset of any neighborhood of my, h would have 
to vanish identically, which would imply that S is the zero distribution. Since I is 
assumed to be strictly convex, the wedge W (0, I’) is connected if © is connected 
and sufficiently small. This proves the lemma. 

To construct the C* CR function of the proposition we shall use the following. 
As in §2 we can find / vector fields D; satisfying, for 1 <q <n, 1 Sj, p<, 


[L,, D;) = 0, [D;, D,) = 0, and Dj(sp as ip, (z, z s)) = jp ’ 


where the @, are as in (2.2). 


Lemma 4.4. Let S be a CR distribution defined in a neighborhood of my in M. Then 
for any k there is a CR function fe C* defined near mg such that 


s=( y DV 


Isjsl 


where the D, are the vector fields defined above. 


This lemma is a consequence of the representation of distributions annihilated 
by a system of complex vector fields given in [5] (see also [13]). 

We may now prove Proposition 4.2. By Theorem 1 we can find a CR 
distribution 7 in an open subset U with support in N. By Lemma 4.4 we may write 
T=(Yisjsi D?)?f with f a CR function of class C*. We reason by contradiction. 
Assume that f is the boundary value of a holomorphic function H in a wedge 
W (0,1). Since D; is of the form 


7) 


F 
D,=—+ a —— 
Ow; 1: fze 7 Om 


(see [3]), we have (5) = D(H). Note that co is of slow growth, by Cauchy’s 
Ww; Ww: 


J 
inequalities. We conclude 


0H ¢ e \V 
os) r( 3,00.) 


It would then follow from (4.5) that T is the boundary value of a holomorphic 
function, contradicting the conclusion of Lemma 4.2. The proof of Proposition 4.2 
is now complete. 


J 


Proof of Theorem 2. We assume by contradiction that every smooth CR function 
defined near m, extends holomorphically in some wedge. We claim that for every 
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open neighborhood U of myéM there exists a wedge W (0, I’) to which every 
smooth CR function defined on U extends holomorphically. Indeed, this follows 
from an argument using the Baire category theorem by a slight modification of the 
proof of Theorem 7 of [4], where the corresponding result is proved for continuous 
functions. We shall show that if k is sufficiently large, then any CR function of class 
C* defined near my extends to a wedge, contradicting Proposition 4.2. 

If U is a neighborhood of mo, let E be the space of smooth CR functions on U 
and W (0, I’) the wedge associated to U by the claim above and denote by # the 
space of bounded holomorphic functions in W (0, I’). By the closed graph theorem 
the mapping E— # which to each CR function associates its holomorphic 
extension is continuous. We can therefore find k, U’ relatively compact in U and a 
constant C such that for all fe E, 


sup. ew (o,r)| A2)| $ C Supm eu’ |D* fm)| , (4.6) 
lal Sk 
where f is the holomorphic extension of f. Since every CR function of class C* is 
locally a limit, in the C* topology of entire functions [5], it follows from (4.6) that 
every CR C* function on U extends holomorphically to W(0, I’). Theorem 2 is 
then proved by contradiction. 


§5. Characterization of minimal CR submanifolds; proof of Theorem 3 


The proof of the uniqueness in Theorem 3, as well as the characterization in (i), is 
essentially based on the following localized version of a result of Sussmann [11]: 
Let {X,,...,X,} bea set of smooth real vector fields defined near the origin in R’, 
and U’ a sufficiently small neighborhood of 0. Then there is a unique submanifold 
N < U’, 0€N, such that the X; are all tangent to N at every point of N and for 
which dim N is minimal with this property. Its uniqueness follows from the fact 
that it is the union of all points in U’ which can be reached by a finite sequence 
of integral curves, contained in a slightly bigger neighborhood U, of the vector 
fields X ;. 

We now consider the case of a CR manifold M. We take for X,,..., X2, a 
basis for the real and imaginary parts of the local CR vector fields L,, i.e. for the 
sections of ReV. A submanifold N of M is a CR submanifold of the same CR 
dimension if and only if all the X; are tangent to N. Now the uniqueness and the 
characterization (i) follow from Sussmann’s result stated above. 

To show that Nj, can be characterized by (ii), we assume that M is embedded 
and use the following result of Tumanov [14]: There is a CR submanifold of M 
through m, contained in the union of sets of the form Z(bD), where Z: D > C"*' is 
continuous, holomorphic in D and satisfying m)¢Z(bD) <c UM M, and U is a 
sufficiently small neighborhood of my in M. We shall show that the image of bD 
under all such holomorphic discs Z lies in the minimal submanifold Ny. Hence the 
proof of Theorem 3 will be completed by the following. 


Lemma 5.1. Let M be a generic CR submanifold of C"*' and N a CR submanifold 
containing mg. Then there is a neighborhood U of mo in M such that for every 
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Z: D + C"*! with Z holomorphic, continuous in D and satisfying 
m,€Z(bD) < UMM, then Z(bD) KN. 


Proof. We use the coordinates (x, y, s, t) = (x, y,$1,-- +5 S,51,-..,t,) introduced 
in §2, so that N is the submanifold {t = 0}. For a disc Z as in the statement of the 
lemma, we write Z(¢) = (z(¢), w(¢)); we may assume without loss of generality that 
Z(1) = mo. Then 

Rew(f) = — T,(p(z(-), 2(-), Rew(-)))@, CebD, (5.2) 


where ¢ is given by (2.2) and 7, f is the harmonic conjugate of f, defined on bD 
vanishing at 1. As in (2.7) we may write 


Rew,(Q)=s(0), Isjsh, 
Re w,(¢) = ¢,(2) + w,(z(¢), 2(¢), s()), 1Sjsh. 
Equation (5.2) becomes 
s;(C) a T, (9,(z, 5 S, t+ W(x, Jy, s)))(¢), 1 Sj ~ l,, 
(2) + wj(z(2), 2(2), s(C)) = — T1(j41,( 2 5,t+ Wz, zs), 1Sjsh. 
(5.3) 
We claim that (5.3) implies that t(¢) = 0 for all ¢€bD, which is the desired 
conclusion. We shall show first that 
LW, (z, z, S) + iO; +1,(2, Zz, 5, w(z, z, s)) = 0, 1 $j l,, 1 Sksn, (5.4) 
where L? is given by (2.6). Indeed, since 
L,g; = 9, l<jsbh, E<sksn., (5.5) 


where g; is given in (2.7), we obtain (5.4) by putting t = 0 in (5.5). Now the claim 
follows from a standard approximation argument as follows. Since 

9) = W(z, Z, 8) + if; +1,(z, 2, s, W(z, Z, s)) is a CR function for the induced CR 
structure on N, it is the uniform limit of holomorphic polynomials [5]. By the 
maximum principle, the pullback of g}? to bD by the map (z(¢), s(¢)) extends 
holomorphically to D. Therefore we have, since (0) = 0, 


W (2, 20), 80) = — Tr1(bj 41, 2 8, Wz 2 90), 


which proves that t(f) = 0 is a solution of the second equation in (5.3). Since the 
map 


t—> T, [Oj +1, (2, z, S,t+ y(z, z, s)) ee Pj +1, (2, z, S, w(z, 2, s))] 


is a contraction in L?(bD) if the neighborhood U of the lemma is sufficiently small, 
the solution is unique, which proves the claim, and completes the proof of the 
lemma. 


§6. Other results and remarks 


Inspection of the proof of Theorem 1 shows that its conclusion holds under 
assumptions weaker than embeddability of M. We can also weaken the smoothness 
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assumption for M. If N isa CR submanifold of an abstract CR manifold of class C? 
we shall say that M is locally embeddable of order | along N if around every point 
mo€N there exist n + | functions Z; of class C? such that for every L section of V 


LZ ;(m) = O(dist(m, N)?). 


Theorem 4. The conclusion of Theorem 1 holds if M is of class C? and locally 
embeddable of order 1 along N or if dim N = 2n. In addition, without assuming 
embeddability, if N is of codimension 1 in M then the function which is identically 
equal to 1 on one side of N in M and equal to 0 on the other side is a singular CR 
function. 


Proof. As mentioned above, the conclusion when M is locally embeddable of order 
1 along N follows by inspection of the proof of Theorem 1. To prove the statement 
when dim N = 2n, we choose coordinates u = (u,,..., U2,), t =(t,,..., t,) such 
that N is given by t = 0. We may write the L; in the form 


0 
ine (U, t)t,— . 6.1) 
ees * at, 
By the Newlander-Nirenberg Theorem [10], we may find coordinates 
x =(x,,.-.,Xn)) ¥=(1,---, Y,) Such that after a linear transformation on the 
basis L; we have 

2n 


6 é 
Fo = : ; 0 — S——, 
r Ra Oyu (U Ou, 0z; 
We then have 
0 ; 0 é 
ee Aalae tte. Marla t > 


n k ls 
l 


L 


ee 
Hine ty + (5.2) 


sl 


l 1 
As in the proof of Theorem 1, we look for a solution of the form V(x, y)d(t). For 
this, it suffices to solve the system 


LoV+ YY p,(z,z,s3V=0, 1Sjsn. (6.3) 
lersil, 
The equations (6.3) can be solved since the compatibility conditions needed for 
the existence of a solution follow from the commutation relations [L;, L,] = 0 for 
all j, k. 
Finally, we consider the case where codimy N = 1. Since the L; are tangent to 
N, the Heaviside function H which is equal to | on one side of N and 0 on the other 


side satisfies L,H =0 in the distribution sense. This completes the proof of 
Theorem 3. 


Remark 6.4. The conclusion of Theorem 1 need not hold without the embedd- 
ability condition, as shown by the following example. Let M = R* with coordinates 
(x, y, Ss, t) and let 


0 0 sh 
=a = ize + y(z, Z, sta (6.5) 
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with » a smooth function in R? not in the range of the Lewy operator 


6 é ; : 
L° = 7. iz - (see [8]). It is clear that finding a solution of the form 
V(x, y, s)d(t), with V(0) + 0 is equivalent to solving the equation L°V — pV = 0. 


Note that in this example the Heaviside function H(t) is a singular solution. 


Proposition 6.6. If M is a real analytic generic manifold which is not minimal at mg, 
and N a real analytic CR submanifold of M, then there is a holomorphic submanifold 
H in C"*', such that N=Ma# with dimgN = dimc# + n. In particular, the 
minimal CR submanifold through mg is of this form. 


Proof. We choose coordinates (x, y, s, t) as in §2. Here the @; and y, as in (2.7) are 
real analytic functions in a neighborhood of 0. Since L? g? = 0 and the gp are real 
analytic, there exists a holomorphic function G,(z, w,,..., w;,) such that g? is the 
restriction of G, to N. In the new variables w; = w;, 1 Sj <1,, and wj,,, = Wj+1, 
— G,(z, w,,..-, W,), 1 Sj Sl,, we have N = Ma {wj,,, = 0, 1 Sj <I,}. This 
proves the first statement. To prove the second claim, it suffices to observe that 
when M is real analytic, the minimal CR submanifold through mg is the Nagano 
leaf (see [9]) of the sections of Re¥, which is real analytic. 


Remark 6.7. If M is assumed only to be smooth rather than real analytic, the 
minimal CR submanifold N need not be of the form N=Ma# with # a 
holomorphic submanifold. Indeed, consider the generic submanifold of C? para- 
metrized by (x, y, s, t) and given by {(z, w,, w2): w, = 5 + i|z|?, w, =t + A(x, y, s)} 


; ; , ae oh lie 
where h is a smooth non real analytic function satisfying ran iz 3s Here N is given 


6 0 
by {t= 0} and L= 35 iz ay If N were the intersection of M with a complex 
Zz Ss 


hypersurface, there would exist a holomorphic function # and holomorphic 
coordinates (z’,w,w,) such that h is the restriction of #(z’,w,,w,) to N, 
contradicting the assumption that h is not real analytic. 
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Introduction 


Let F be a totally real number field, G be a semi-simple F-algebraic group, 
G,, = G( F @qR) be the group of real points, K be a maximal compact subgroup of 
G,, and X = K\G,, be the associated symmetric space. Choose a G,,-invariant 
Riemannian metric on X and let w, be its curvature form. There exists a unique 
Haar measure p on G,, such that the image of on the homogeneous space X is the 
measure defined by w,, [8] §3.2. Let I be a torsion free arithmetic subgroup of 
G(F), then X/T is a manifold with finite volume and it follows easily from the 
Gauss-Bonnet-Allendoerfer-Weil-Chern theorem that fe. pr H=X(X/T), in case 
X/T is compact, [8] Prop. 22. Remarkably, this formula for the Euler characteristic 
of X/IT continues to hold even without the compactness hypothesis, but this is 
a much deeper result, [3], [8] §3.6. 

The purpose of this paper is to show that there is an analogous formula for the 
arithmetic Euler-Poincaré characteristic of a smooth, projective surface & defined 
over a finite field and possessing a fibration by curves. This Euler characteristic 
arises from the étale cohomology of the constant sheaf Z and is thus intrinsic to the 
surface. The Gauss-Bonnet formula shows that it can basically be expressed in 
measure theoretic terms. (See Section 2 for the statement and proof of the theorem.) 
On the other hand, just as the form wy and the measure yp depend on a choice of 
a Riemannian structure on X, the measures and the arithmetically defined lattices 
associated to & are constructed using a specific fibration. Their definition and the 
calculation of the covolumes associated to the fibers are given in Section 1. 
Combining this computation with an L-series argument gives the asymptotic 
behavior of the product of these covolumes. 

The definition of the Euler characteristic y(@, Z) and Milne’s theorem relating 
its value to the residue of the zeta function of the surface at s = 0 are recalled at the 
beginning of Section 2. The Gauss-Bonnet formula then follows easily from his 
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result and the calculations in the previous section. The formula can be given quite 
explicitely when & is the complete Néron model of an elliptic curve defined over 
a function field. In Section 3 this is worked out in detail for the case of a semi-stable 
fibration. 


The author thanks Spencer Bloch and Gopal Prasad for helpful conversations at MSRI and 
greatly appreciates the excellent working conditions he enjoyed there and at IMPA during the 
preparation of this paper. He also wishes to thank the referee for pointing out errors and for 
suggesting improvements in the exposition. 


§1. Let C be a complete, smooth, geometrically irreducible curve over F, and L be 
the function field of C. Let E be a curve over L that is also complete, smooth, and 
geometrically irreducible. Then there exists a regular curve & proper, flat and of 
finite type over C such that the generic fiber is L-isomorphic to E ([1] Resolution 
Theorem). & is smooth projective surface over F,. Let p: & > C be the F,-rational 
projection. We assume there is an F,-rational section o: C > @. 

For each place v of L let q, = q*’”. For all but a finite number of v, p~ ‘(v) is 
smooth and may be regarded as a curve over F,. The other fibers may be singular 
or even reducible. In this section we define the measures and lattices associated to 
the fibers, give a formula for the covolumes of the lattices, and evaluate the limit of 
the product of these constants. For the convenience of the reader, basic facts 
concerning the Tamagawa measure of SL, and standard volume computations are 
recalled in an appendix. Everything mentioned there is contained in [10] or in [11]. 

Let Og, >-1(w,¢ denote the local ring of the component of the fiber over 
v containing ov and k(@,, ,) be its residue field; k(@,, ,) is isomorphic to the function 
field of this component of p~*(v) and has field of constants F,, . 


Definition. For each place v of L, let t, denote the global Tamagawa measure for 
SL,(k(@,,,)) and set uw, = q2%~3(1 — q, ')t,, where g, is the genus of k(@,, ,). 


Remark. The factor q34~3(1 — q;') plays a role analogous to the convergence 
factors introduced by Weil in the study of affine algebraic groups, [11]. 


Let k(@,, «)e, be the completion at ov. This locally compact field with residue 
field F,, is isomorphic to F,, ((7)) and thus also isomorphic to L,. For each v choose 
an embedding i,: k(é,,,) > L,, continuous for the ov-adic topology, of the global 
field into L,. Though there is no canonical way to do this, i, provides a metric on 
the functions of k(@,,,). Another choice of the embedding would give the same 
metric. This procedure is analogous to the choice of a Riemannian structure on the 
symmetric space X mentioned in the introduction and gives volumes associated to 
each fiber of p. 


Definition. Let a,,,) be the subring of k(&,,,) consisting of functions which are 
integral at all places of k(,,,) except ov and set [, = SL,(i,(aen))). 

Proposition. For a place v of L, let M, = p,(SL,(L,)/T,), then M, = (1 — q, ) 
(1 — qo") Cave, ,)(2)- 


Proof. The proposition follows immediately from the definitions and the lemma in 
the appendix. 
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Definition. For a finite set of points S < C let U = C — S and L,(S) be the ring of 
S-adeles. Let YJ, = SL,(L,(S)) = [res SL3(L,) x []reu SL2(r,), where r, denotes 
the ring of integers in L,, and py, be the measure pal [Joes Hy X []vev @,, with 
h = [Jac(C)(F,)] and with g = genus C. Let #, be the lattice [Joes T, x []vev I, in 
i) and M, = us(Gs/#s). 


1 
G,;, where I, = 
s, where I,=\ 9 , 


Lemma. Let M,, denote the covolume given in the proposition, then II1M,, converges 
—1)l 

to 4 — SOB 4 1(¢, 2)-1- IK, - Res, 0(8, 8), where K, = Cues )(2)6(6,, 2)” * and 
ae” 0 

the product extends over all v such that p~‘(v) is singular. 


Proof. It follows from the Riemann hypothesis that the function L(s)~' = ¢(C, s)~! 
(q — \)log q 
hq 
C(C, 2)~* Res,-2 C(6, s) at s = 2. Since ¢(6, s) is given by the absolutely convergent 
product []vcc (6, 8) for Re s > 2, L(s)"! = [Jocc(1 — a5 °)(1 — ah 7*) £(6,, 8) in 
that half-plane, but in fact this product converges absolutely for Re s > 3/2 and 
thus takes the value given above at s = 2. By the proposition the factor in L(2)~! 
equals M, for all ve C such that p~ '(v) is smooth; the lemma now follows from that 

proposition. 


¢(C,s — 1)~' ¢(@,s) is holomorphic for Re s > 3/2. It has value 


Proposition. Let M = lims Mg, where the limit is taken over increasing finite subsets 
S of C, then M = (log q) ¢(C, 2)~'-TIK,: Res,-2 €(6, s). 


od hq'~¢ 
Proof. By definition, M, = or T]ies Mv x [leu (1 — 957). For a sufficiently 


large finite set S, M, approximates |], M, arbitrarily closely so the proposition 
follows from the lemma. 


Definition. The constant M will be called the covolume of the system of triples 
(Gs, Hs, Us). 


Appendix 


Let K be a global field of genus g with field of constants F,, G = SL,(K), Ga be the 
adelization of G and G, be the principal elements. For a place v of K denote by R, 
and F,, respectively, the ring of integers and residue field of K,. Recall that the 
local Tamagawa measure w, on SL,(K,) is the Haar measure which gives the 
compact subgroup SL,(R,) volume 1—7;? and that the global Tamagawa 
measure t on G, is °9~ > times the product measure ITw,,. G, is a discrete subgroup 
of G, and t(G,/G,), the Tamagawa number of G, is one, [10], [11]. 

Let a,,, denote the subring of K consisting of elements which are integral at all 
places w of K, w + v, O = M,(aq)), O' = SL3 (a), O, = O@a,, Ry, OF = SLz(R,) 
and C=[|,.,0%. Let U=SL,(K,) x C. U is an open subgroup of Ga, 
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Gy, = G,U, Gg AU = O'," hence U/0' is isomorphic to Ga /Gx and O’ is a discrete 
subgroup of U with covolume one. 

Let p denote the projection of O' on the factor SL,(K,) of U. By [10] IV §1, 
Lemme 1.2, p(O') is a discrete subgroup of SL,(K,) with finite covolume. Clearly 
U/O'C and SL,(K,)/p(O') are isomorphic. Let t denote the Tamagawa measure 
transported to SL,(K,)/p(O'). 


Lemma. 1(SL,(K,)/p(O*)) = 2°~°9(1 — ¢5)£ x (2). 


Proof. By the isomorphisms above and the fact that 1(U/O')=1, 
t(SL2(K,)/p(O*)) = (C)~* = t([] w+ On) *. As O} = SLA(R,,), tT ]w +0 On)” * 
= 2-8 TT 4 o(l — 52). 


§2. Let H'(&, Z) denote the étale cohomology group of the constant sheaf Z. Then 
H°(@, Z) = Z and H'(é, Z) is torsion for i > 0, [5], Cor. 7.2. For i > 3, H'(6, Z) is 
finite and is isomorphic to H‘(é, Z) = [], H‘(é, Z,), where the product is taken 
over all primes / including / = p, [5] Cor. 7.6(a). Hence H'(é, Z) = 0 for i > 5, [4] 
VI, Cor. 1.4 and Remark 1.5(b). H'(6, Z) is also finite, [5] Lemma 9.1, and 
H?(6, Z) = H?(6, D)cotor ® Q@/Z where H?(&,Z) is the cotorsion subgroup of 
H?(é@, Z), [5] Remark 7.7(a). Let 


[H°(E, Z)ior | LH? (8, Z)cotor] LH*(6, Z)] 
[H*(6, Z)][H°(6, Z)][H°(6,Z)]” 


where [G] denotes the order of a group G. 

Theorem 0.4 (a) of [5] asserts that lim,9(1 — q-*)¢(@, s) = + x6, Z). (Note 
the obvious misprint in the statement on p. 301). The functional equation for ¢(é, s) 
takes the form ((6, 2—s)=+q''~** f(&,s), where x is the self-intersection 
number of the diagonal on & x &. (The number x may also be interpreted as the 
second Chern class of the tangent bundle on @ or as the Euler-Poincaré character- 
istic in ¢-adic étale, 7 + p, or in crystalline cohomology, [4] V, Thm. 3.12, [5] § 10.) 





x(é, Z) = 


Theorem. Let M be the covolume of the system (9,, #,, u,), and for ve C such that 
p‘(v) is singular let K,, be the constant defined in the lemma of Section 1, then 
x(€, Z)= M q-* ((C, 2) Ky’. 


Proof. Since both sides of the formula are positive, the ambiguities of the signs in 
Milne’s theorem and in the functional equation will be disregarded in the proof. Let 
L(s) be the function defined in the proof of the lemma in Section 1. In the half-plane 
Re s<1/2, L(2—s)~'is given by the absolutely convergent product 
[Tec (1 — 93-7) (1 — g8"*) &(6,, 2 — s). By the proof of that lemma and the pro- 


position following it, this product converges to : qi. 9 


M-IIK;' as s approaches 


zero. On the other hand, L(2 — s)~! = ¢(C,2 — s)~! €(C,1 — s)~! q*'-® C(6, s). 
Write €(C, s) = P-(q~*) (1 — q~*)~' (1 — q'~) 71, then L(2 — s)~! = (C,2 —s)7! 
P(g) * (l-@*)(l-@) ge? (6,5), so L(2)>* =C(C, 2)°* qth" 
(1 — q~')q* x(@, Z). The theorem now follows by comparing the two expressions 
for L(2). 
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It is rather surprising that three of the terms appearing in the theorem have 
interpretations in K-theory. The constant sheaf Z is the sheaf on &;, associated with 
the presheaf U > K,(I'(U, 0,)) and it is from this point of view that Milne [5] §7 
studies its cohomology; in other words, y(@, Z) really means y(6, Ky ©,). The factor 
C(C, 2) has value q~*9 (1—q~?)~' (1—q~')~! [Ker A,], where 2,: K,(L)>]], 
Fy, is the tame symbol and g is the genus of C [9] §4. Finally, let K,,,, be the two 
dimensional local fields associated to & by Parshin [7] §2. There is an adele group 
I, =|], p K2? (Km, p) and a homomorphism | |: J, > R. He then associates a class 
of adeles to differential forms on & and proves that for any adele a in this class 
|a| = q’. 


§3. In this section let & be the complete Néron model of an elliptic curve over 
L and assume that the fibers of the projection p are semi-stable. In this case the 
term J1K,, appearing in the theorem in Section 2 can be easily computed. Recall 
that the component of a singular fiber containing ov is either a rational curve with 
a node ([6] III §10, case b,) or a projective line (loc. cit. case b,,, m > 1), so in both 
cases the function field k(@,,,) of Section 1 has genus zero; since there are no 
non-trivial Severi-Brauer varieties over a finite field, it is a field of rational 
functions and (yg, y(s) = (1 — qo *)* (1 — qe *)*. 

The zeta function of &, itself can be found by examining the fiber and its 
cohomology. An F,,-irreducible component @,,, of &, may split into distinct 
irreducible components over F,,. Let c,,, be the number of these components and 
P(&,, T) denote the characteristic polynomial of the geometric frobenius mor- 
phism acting on the /-adic étale cohomology group H' (6,, Q,). The zeta function 
of @,, is 


P8,, T) 
(1 — T)M(1 — (q,7)“*)’ 


where the product extends over all F, -irreducible components of &, and T = q, °, 
[2] Prop. 3.3. (Note the misprint in the statement, though not in the proof, on p. 
176.) 

The set of smooth points of the component of &, containing ov form an F,, -torus 
that may or may not be split. In case b,, &, is geometrically irreducible and 
PA€,, T) equals 1 — T, if the torus is split and 1 + T, if it’s twisted. In case b,,, 
m> 1, &, consists of m, projective lines, each with self-intersection —2 and 
forming a “polygon”. In the split situation, each of these components is F, -rational, 
so the product in the denominator of Z(@,, T) has value (1 — q, T)"’. It remains to 
treat the case b,,, m > 1, in case the torus is non-split. Here it makes a difference 
whether m, is even or odd. If m, is even, two of the projective lines are F, -rational 
(the one containing ov and the one of order two in the cyclic group formed by the 
components) and the other m, — 2 occur in Fg2-conjugate pairs. Thus, the product 
in the denominator of Z(6,, T) equals (1 — 4,7)? (1 — (q,T)?)"~ ?”?. For m, odd, 
the line containing ov is F, -rational, the other m, — 1 appear as F,2-conjugate 
pairs and the product has value (1 — q,7)(1 — (q,7)*)"*~ !”?. Since IK, = 


Z(é,, T) = 
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M(1 —q,7)"! (—q,')7! C(6,,2)7}, it is determined by these expressions for 
Z(é,, T). 

The value of ITK,, can also be calculated for the Néron model of an elliptic curve 
when there are fibers of additive type. This is done by carrying out the same kind of 
case by case analysis as in the semi-stable situation, but based instead on the tables 
in [6] Ill §11-15. 
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§1. Introduction 


Let p be a prime number, F, the finite field of q = p* elements. Let f be an 
F,-regular function on (G,,)”" and write 


fu) axeB fy, ney... (1.1) 
jeJ 
where the sum is over a finite subset J of Z". We assume a; + 0 for all jeJ. Let 


¥:F, > Q(¢,) be a nontrivial additive character (where ¢, is a primitive p-th root of 
unity) and set 


S(= L _ PoTr(f(xy,---, x )EQE,) » (1.2) 


Kige'e 50.9 Ryle ge 


where Tr;:F,, > F, is the trace map. The corresponding L-function is 


S Si fy)eQe NECA. (13) 


Lif, = exp( 


By well-known theorems of Dwork and Grothendieck, L( f, t) is a rational function, 
say, 


eae 


(1.4) 
Thus 


S(f) => Bi - Yai, (1.5) 
l j 


so the problem of estimating |S;( f)| can be reduced to the problem of estimating 
the |a;| and | 8]. 

Define the Newton polyhedron of f, denoted A(f), to be the convex hull in R” of 
the set J U {(0,. . .,0)}. Given a face o of A(f) that contains the origin, let L(a) be 
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the smallest linear subspace of R" containing o. We define the dimension dim o of 
a to be the dimension of L(a), and we define V (c) to be the volume of o relative to 
the induced lattice, i.e., V (c) is the volume of o with respect to Haar measure on 
L(c) normalized so that a fundamental domain for the lattice L(a) 7 Z" has volume 
1. This is easily computable as follows. By simplicial subdivision, one may reduce to 
the case where a is a k-simplex with one vertex at the origin and k vertices in Z”. Let 
M(o) be the (k x n)-matrix whose rows are the coordinates of the nontrivial 
vertices of o. Then k! V (c) is the greatest common divisor of the (k x k)-minors of 
M(c). When the origin is itself a vertex, so that og = (0,.. . , 0) is a face of A(f), we 
set V (60) ial I 

In particular, we regard the entire Newton polyhedron A(f) as a face of itself. 
We denote V (A(f)) simply by V (f). Let V(f) be the volume of A(f) with respect 
to Lebesgue measure on R”. Thus 


Vif) if dimA(f)=n 
0 if dim A(f) <n. 


rin=4 


For any face o of A(f), let 


fa= ¥ a;x’. (1.6) 


jeaond 


Recall that fis nondegenerate (with respect to its Newton polyhedron) if for every face 
o of A(f) that does not contain the origin, 0f,/0x,,..., 0f,/dx, have no common 
zero in (F,‘)", where F, is the algebraic closure of F,. 
We proved in [1] that if fis nondegenerate and dim A(f) = n, then L( ft)” 
is a polynomial of degree n! V(/): 
nl Vif) 


Ligy-"' = T] pit). (1.7) 


When p is sufficiently large relative to A(f), we showed in addition that 
Lif) " = det (I — tF|H2(G,,)" x ,F,, Zy(f))) , (1.8) 


where #,( f) is the lisse, rank-one, /-adic sheaf on (G,,)” associated to the exponen- 
tial sums (1.2), H? denotes /-adic cohomology with proper supports, and F is the 
Frobenius automorphism. Since #,(f) is pure of weight 0, it follows from 
Deligne’s theorem [2] that each p; is an algebraic integer pure of weight w(p;) for 
some integer w(p;), 0 S w(p;) <n, ie., 


lpil = a" 


for every complex imbedding of p;. For 0 < k < n, let w, be the number of roots of 
weight k: 


Ww, = # {p;|w(p;) =k} . 


The purpose of this article is to give an explicit formula for w, under a certain 
hypothesis on 4(f). We shall also conjecture a general formula for w,. For any face 
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o of A(f) that contains the origin, set 
v(a)=(— 8 FY (= 1) (dim2)!7 (2), (1.9) 
(0,...,0erce 
where the sum is over all subfaces t of o that contain the origin. Let a, be the 
smallest face of A( f) that contains the origin. We call A(f) simplicial with respect to 
the origin if dim A(f) =n and oy is contained in exactly n — dimay faces of 
dimension n — 1 of A(f). Note that this condition is always satisfied when n = 2. 


Theorem 1.10. Let feF,[x,,..., Xp) (x, .-.X,)~'] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin. If p is sufficiently large (depending on 
A(f)), then 

w= YY vo), (1.11) 


(0,...,0e0 
dima =k 


the sum being over all faces o of A(f) that contain the origin and have dimension k. 


Example. Let f(x, y) = x?y* + x~3y® + y®. Then A(f) is the quadrilateral in R? 
with vertices (0, 0), (2, 4), ( — 3, 6), and (0, 8). If p + 2, 3, then fis nondegenerate, so 
L(f, t)~' is a polynomial of degree 2! V( f) = 40. Besides A(f), there are three other 
faces containing the origin: o, = (0,0), o, = line segment from (0, 0) to (2, 4), and 
o, = line segment from (0,0) to (— 3, 6). We have V (60) = |, V (,) = 2, and 
V (c,) = 3. The theorem implies that for p sufficiently large (in fact, in this example 
one needs to exclude only p = 2,3) w, = 40 -—2—3+1 = 36, w, =(2—1)+ 
(3 — 1) = 3, and wy = 1. In particular, 


IS(f)| S$ 36q' + 3./qi +1. 


Remark. If the origin is an interior point of A(f), there are no k-dimensional faces 
containing the origin when k < n. Hence w, = 0 for k <n, ie., the roots of the 
exponential sum are pure of weight n. This special case of Theorem 1.10 was proved 


in [1]. 


The basic idea of the proof is as follows. For fe F,[X;,..-,X,] one can form an 
exponential sum on (G,,)" or on A”. In the appendix to [1], we explained how the 
associated cohomology on (G,,)" decomposes and identified one of the “pieces” as 
being the cohomology on A”. This allowed us to extend some of our results from 
exponential sums on (G,,,)” to exponential sums on A”. The main observation of this 
paper is that when feF,[x,,...,X,,(x,...X,)~'] and A(f) is simplicial with 
respect to the origin, there is an analogous decomposition corresponding to the 
codimension-one faces of A(f) and each of the resulting pieces is pure, ie., all 
eigenvalues of Frobenius have the same weight. The number of eigenvalues of 
a given weight is then the sum of the dimensions of the appropriate pieces, which 
can be explicitly computed. 

To state the general conjecture, we first rewrite formula (1.11). For any face o of 
A(f), let F,(j) be the number of j-dimensional faces of 4(f) that contain o. It is 
straightforward to check that 

yy vo=(-1* YY (- 1)" F,(k)(dimo)! V(o). (1.12) 


(0,...,0e¢ (0,...,0e¢ 
dima =k dimo sk 
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Conjecture 1.13. Let feF,[x,,.. ., Xp, (x1. ..X,) '] be nondegenerate and suppose 
dim A(f) =n. Then 
n—dimo 


Pe ee Fe _ 1)dime a aa 
wat Lt 8 (tt) + Folk 1 ere 
dimo sk 


)) (dim a)! V (0) , 


(1.14) 
the sum being over all faces o of A(f) that contain the origin and have dimension < k. 


Note that when A(/) is simplicial with respect to the origin, 


n—dimo 
rae =(" ON), 


so by (1.12), Theorem 1.10 is a special case of Conjecture 1.13. The restriction that 
dim A(f) =n is not serious, since, if dim A(f) <n, one can make a coordinate 
change on (G,,)" that transforms f into a Laurent polynomial involving only 
dim A(f) variables (coordinate changes on (G,,,)” preserve nondegeneracy). 


Remark added: Our evidence for this conjecture was based on the simplicial case 
(Theorem (1.10)), the three variable case (which we hope to publish subsequently) 
and several higher dimensional examples. Denef and Loeser have recently an- 
nounced a proof of a general formula for the weights w, which disproves Conjec- 
ture 1.13 in general. 


Example. In [8], Katz finds a lower bound for the “generic” number of roots of 
highest weight for exponential sums involving linear polynomials on two types of 
hypersurfaces. By a well-known procedure, these exponential sums can be ex- 
pressed as exponential sums on affine space. Restricting to (G,,)" does not change 
the number of roots of highest weight. Theorem 1.10 gives an explicit formula 
(when p is sufficiently large) for the number of roots of highest weight in one of the 
cases considered by Katz [8, Corollary 6.5] (this also follows from [1, Theorem 
5.17]). Conjecture 1.13 implies that Katz’s lower bound in the other case ([8, 
Theorem 6.9 and Lemmas 6.12 and 6.13] is actually the precise number of roots of 
highest weight in the generic case. Theorem 1.10 and Conjecture 1.13 also give 
explicit conditions on the linear polynomial that insure it will be sufficiently 
generic. 

The paper is organized as follows. In section 2, we recall the results from [1] on 
which this paper is based. In section 3, we describe the decomposition of the Koszul 
complex corresponding to the faces of 4( f) containing the origin. This allows us to 
reduce the problem of obtaining archimedian estimates to the problem of obtaining 
p-adic estimates (equation (3.21)). In section 4, we reduce this p-adic question to 
some combinatorial formulas (Lemma 4.13). Finally, in section 5, we prove the 
combinatorial formulas. 


§2. Preliminaries 


We begin by recalling the main results of [1]. Let Q, be the field of p-adic numbers 
and Z, the ring of p-adic integers. Set Q, = Q,(C,), a totally ramified extension of 
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Q, of degree p — 1. Denote by K the unramified extension of Q, of degree a and set 
Q, = K(¢,). The Frobenius automorphism x — x? of Gal (F,/F,) lifts to a generator 
t of Gal (Q,/2,) ( = Gal(K/Q,)) by requiring t(f,) = ¢,. Let Q be the completion 
of an algebraic closure of 2). Denote by “ord” the additive valuation on 2 
normalized by ord p = 1, and by “ord,” the additive valuation normalized by 
ord, q=1. 

Let C(f) be the cone in R” over A(f), i.e., C(f) is the union of all rays in R” 
emanating from the origin and passing through A(f). The lattice points 
M(f)=Z"OC(f) in C(f) form an additive monoid. For each ue M(f), the 
half-line from the origin through u intersects A(f) in a face that does not contain 
the origin. Let )"7_ , 6x; = 1 be the equation of a hyperplane passing through this 
face. We define the weight of u, denoted w(u), by 


w(u) = y Ui; « (2.1) 


Clearly, w(u) is the smallest nonnegative real number such that w(u)A(f) (the 
dilation of A(f) by the factor w(u)) contains u. There is a positive integer M such 
that w maps M(f) into M~'Z,. 

The weight function is easily seen to have the following properties: 


Lemma 2.2 (a) w(u) = inf {>} js a1 Dies Xi = u, 4j;€Q, a, 20}. (This infimum is 
easily seen to be a minimum.) 

(b) If leZ.,, then w(lu) = lw(u). 

(c) w(u + u’) S w(u) + w(u’), with equality holding if and only if u and wu’ are 
cofacial, i.e., w(u)~'u and w(u’)~‘u’ lie on the same closed face of A(f). 


Let E(t) be the Artin-Hasse exponential series: E(t) = exp().,t”/p'). Let 
yeQ, be a solution of )) 7, t”'/p' = 0 satisfying ord y = 1/(p — 1), and consider 


O(t) = E(yt) = y A;t'e Q,[[t]] - (2.3) 


The series 0(t) is a splitting function in Dwork’s terminology [4]. In particular, its 
coefficients satisfy ord A; = i/(p — 1). We fix a choice } of M-th root of y in Q and 
set Q, = = 2)(7), Q, = Q, 1(}). We extend teGal(Q,/Q,) to a generator of 
Gal (Q,/Q, ) by setting t(}) = 7. Let 6 be the ring of integers of Qo. 
Let f= Dies 4 PEK [Xy,. . 5 Xps (x, ...X,)!] be the Teichmiiller lifting 
of f, i.e., (@;)4 = a; and the reduction of f a p is f. Set 
F(x) = [] 0(4;x’) (2.4) 


jeJ 


@=4 
Fy(x) = [] Fv (x”). (2.5) 
i=0 


Define an operator y on formal Laurent series by 


4 yr 4.x") = Yr A,X". 


ue M(f) ueM(f) 
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The operator « = wo F, is a completely continuous Q ,-linear endomorphism of 
the space B, where 


B=| y AM" x"| Ae, A, 70 as u-rooh. 


ue M(f) 
The Dwork trace formula asserts that 
Si(f) = (qi — 1)"Tr(a'|B) , (2.7) 
where the nontrivial additive character ¥ implicit on the left-hand side of (2.7) is 
given by 
Y(t) = O(1) Tee (2.8) 
for te F, (by [4, Lemma 4.1], 0(1) is a primitive p-th root of unity). Equivalently, 


one can define an operator 6 on formal power series with constant term 1 by 
g(t)® = g(t)/g(qt), and then (2.7) takes the form 


Lf, 9"! = det (I — ta)?" (2.9) 
via the relationship det (I — ta) = exp( — ¥2., Tr(«')t’/i). 
Set f, = x,0f/0x,, f, = x,0f/ex ;. We let y, = Y/-,y”/p', which by the definition 
of y satisfies 


ord, 2-1-1. (2.10) 


For i= 1,...,n, define differential operators D, by 
D, = E,+H,, (2.11) 


where E; = x,0/dx, and A(x) = Y 25 y,p'fi"'(x”). The D, operate on B and one 
verifies that they commute with one another and that 


a°D,; = qDou (2.12) 


for d= 1,....4n. 

Let K .(B, {D,}?_ ,) be the Koszul complex on B formed from D,,.. ., B,, i.e. for 
0<l<n, 

K,(B) = ® Be, , 
|T|=1 
where the sum runs over all subsets T ¢ S = {1,2,...,n} of cardinality |, and if 
T = {i,,...,i,} with i,<...<i, then e, is abbreviated notation for 
€;, A... A @;, (the {e;}:-5 being a set of formal symbols). Define an endomorphism 
a, of K, by 
Oo, = q'a. 
|T|=1 

Equation (2.12) implies that «, is a chain map on the Koszul complex K .. It then 
follows from (2.9) that 


Lif," = [] det (I — ta, | K,)-™". (2.13) 
1=0 
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Passing to homology, we conclude that 
Lf) 0"" = T] det (I — ta,|H,(K.))~, (2.14) 
l1=0 


where «, denotes the endomorphism of H,(K .) induced by «,. 
Some of the main results of [1] are summarized in the following theorem. 


Theorem 2.15. Let fe F,[x1,.. «5 Xn» (%1 -- - Xq)7 1] be nondegenerate. The complex 
K .(B, {D;}?=;) is acyclic in dimension > n — dim A(f). For0 <1 <n—dimA(f), 
n — dim A(f ) 
l 
copies of H,(K .(B, {D,}"=1)) as q'd&o-module. In addition, H,(K .(B, {D,)R-1)) has 
dimension (dim A(f))!V(f) and &, is invertible. Hence 


Lh, ae i P(t” : (2. 16) 


where P(t) = det (I — ta%| Ho(K .(B, {D,}7- 1)))€Q(¢,) [t] is a polynomial of degree 
(dim A(f))!V(f). Furthermore, for p sufficiently large (depending on A(f)) the 
reciprocal roots p; of P(t) are algebraic integers pure of weight w(p;) for some integer 
w(p;), 0 S w( p;) S dim A(f). 


Proof. All statements except the last follow immediately from Theorem 2.9, Corol- 
lary 2.19, and Theorem 3.13 of [1]. When dim A(/) =n, the last statement is 
a consequence of [1, Theorem 4.2] and Deligne’s fundamental theorem [2]. If 
dim A(f) <n, one can make a coordinate change on (G,,)" that transforms f 
into a Laurent polynomial involving dim A(f) variables and then apply 
[1, Theorem 4.2]. 


H,(K .(B, {D,}- 1)) as &,-module is isomorphic to the direct sum of ( 


§3. Decomposition of the Koszul complex 


Suppose H is a hyperplane in R" passing through the origin: by ,a,X; = 0. 
Suppose in addition the a; are rational. We denote by D,, the differential operator 
on B defined by D =>" ,4;D,. 

Suppose that A(f) is simplicial with respect to the origin and let 
H,,..., Hy~- dims, be the hyperplanes through the codimension-one faces of 4(f) 
that contain the origin, where a, is the smallest face containing the origin. Let 
H,, - dima, +1>- - -» H,, be additional hyperplanes through the origin chosen so that 
the normal vectors to H,,..., H, forma basis for R”. We may assume the equation 


of each H; has the form 
» aX; =0, 
j=1 


where a;;€Z for all i, j and {a;;}7-, have greatest common divisor 1. The differen- 
tial operators {D,,}7=, on B commute with one another and satisfy (2.12). 


Lemma 3.1. Let fe F,[%,...,Xpq.(%1~- ~~ X_)_ J be nondegenerate and suppose 
pf det (a;;). Then Theorem 2.15 is valid with "(DB i}iz1 replaced by {Dy,}?=1- 
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Proof. Since 


(5 aye, = z aj jx ;Of,/0x; 9 
j=l o j= 


the hypotheses that f be nondegenerate and that p / det (a;;) imply that for all faces 
o of A(f) not containing the origin, the polynomials Go. 1 4;jX 0/0), 
i= 1,...,n, have no common zero in (F; )". One can then repeat the arguments of 
[1] with the x,0f/0x; replaced by the )\"_ , a,;x ,0f/0x,. 


j=1 Gij 
For j = 1,...,n —dimoo, we define Q ,-endomorphisms 6,:B — B by 


a 3 A,pureixt) = YAP Mee xe (3.2) 


ueM(f) ueM(f)OH; 


Note that 6; is also a ring homomorphism of B to itself. It is straightforward to 
check that 


Dy,(B) S ker 8; for 1 <j <n—dimo, (3.3) 

07 = 0; for 1 <j <n—dimo, (3.4) 

0;°Dy,°0;=0;°Dy, forl1<Si<n,1SjSn—dimo,. (3.5) 

Set S = {1,2,...,n}, S’ = {1,2,...,n—dimoy}. For ACS’, let 64 be the 
composition of all 6; for j¢ A. Put B* = 04(B). The maps D%, = 94 Dy, for ieS 


are stable on B4. Thus we may form the Koszul complex K .(B“, {D§, }ies- a), 
which we abbreviate by K .(A). Note that we ignore the differential operators Dj, 
for ie A since by (3.3) they are identically zero on B“. For each subset A’ ¢ S’ — A, 
we define a subcomplex K .(A, A’) of K .(A) by setting for 0 <1] <n —|A| 


K(A, A= @ ( 0) (ker, B) er (3.6) 


jeA’-T 


|T| =I 
where the sum runs over all subsets T ¢ S$ — A of cardinality /, and if A’ - T= @ 
we take “()j-4'-7 (ker 0;| B4)” to mean “B4”. It is straightforward to check that the 
boundary maps are stable on the submodules, hence they define a subcomplex. 
Note that K .(A) = K .(A, @) and that K .(@) is the complex K .(B, {Dy,}7=1). 
We can define an action of Frobenius on these complexes. Since the 8, commute 
with w and with multiplication by Fy, we may define an endomorphism 


a, = W%°04(F,): B4 > B4 (3.7) 
that satisfies 
a&4°D4, = qDh,° %, (3.8) 


fori = 1,...,n. Asin section 2, this induces an endomorphism a, : K .(A) > K .(A) 
by setting 


Ma0= @ q'%4:K(A) > KA) . (3.9) 


|T|=1 
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It is straightforward to check that «, induces endomorphisms a, 4 of the subcom- 
plexes K .(A, A’) for all A’ < S’— A, as well. We denote by %, and &,4 4 the 
endomorphisms of the associated homology groups. 

We now explain the arithmetic significance of these complexes. For f as in (1.1) 
and A C S’, put 


= > eptebigey. ia .akre (3.10) 
je O((\ieaH) 
We denote the corresponding exponential sums on (G,,)" by S,(f,) and the 
corresponding L-function by L(f,, t). 

In section 2 we associated to f a Koszul complex K .(B) with Frobenius 
operator « satisfying Theorem 2.15 when f is nondegenerate. The same construc- 
tion can be applied to each f,, and we denote the resulting Koszul complex and 
Frobenius operator by K .(B(f,)) and ay, respectively. Let Bas i=1,...,n,bethe 
corresponding differential operators. When f is nondegenerate, so are all the f,, 
hence Theorem 2.15 holds for the Koszul complex K .(B(f,), {B. Yia) In addi- 
tion, if p ¥ det (a;;) the proof of Lemma 3.1 shows that Theorem 2.15 holds for the 
Koszul complex K .(B( f,), {Ds.n,}7=1), where 


def 2 i 
Dau, = z a;;D, P 
j=1 

Comparing K .(B(f,), 16.3.3) with the complex K .(A) constructed in this 
section, one sees that K,(B( f,)) and K,(A) are naturally identified as Banach spaces 
with action of Frobenius. Under this identification of spaces, the differential 
operator D,y, is identified with Df, for i= 1,...,n. Thus K .(B(f,), {Da u,}7=1) 
and K ,(B4, {D4,}7=1) are isomorphic a3 complexes with action of Frobenius. The 
hypothesis that A(f) be simplicial with respect to the origin implies that 
dim A(f,) =n —|A| foreach A ¢ S’. Keeping in mind that Df, = 0 (as operator on 

B4) for ic A, Theorem 2.15 applied to f, gives: 


Lemma 3.11. Let feF,[x,,...,X,, (x, ..-X,) '] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin and p ¥ det(a;;). For all A < S’, the 
complex K .(A) is acyclic in dimension > 0, dim H,(K .(A)) = (n — |A])! V(f,)s and 
&4,.o is invertible. Put 


P,(t) = det (I — t%4,9| Ho(K .(A))) . 
Then P(t) is a polynomial of degree (n — | A\)! V( f,) and 
L( fy OP" = P(t)". (3.12) 


Furthermore, for p sufficiently large (depending on A(f)) the reciprocal roots p; of 
P,(t) are algebraic integers pure of weight w(p;) for some integer w(p;,), 
0S w(p;) Sn —|Al. 


Corollary 3.13. With the notation and hypotheses of Lemma 3.11, P,(t)€ Q(¢,) [t]. 


We now examine the relations between the complexes K .(A, A’). Let ACS’, 
A’ c S'— A, and je A’. The map 0;: B4 > B+" induces a map 6; of complexes 
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with Frobenius action 


0;:K .(A, A’ — {j}) > K (Au {i}, A’ — {i}) 


whose kernel is naturally identified with K .(A, A’). By (3.4) this map is surjective. 
Hence there is a short exact sequence of complexes with Frobenius action 


0K (A, A’) > K (A, A’ — {iJ > K (AU {j}, A’ - 0. 3.14) 


The associated long exact homology sequence, the acyclicity of K (A) in 
dimension > 0, and induction on |A’| (as in [1, Theorem A.7]) show that 
K .(A, A’) is acyclic in dimension > 0 for all A’ c S’ — A. The associated long 
exact homology sequence then reduces to the short exact sequence 


0 + Ho(K (A, A’)) + Ho(K .(A, A’ — {3})) 
+ H(K (Av {i}, A’ — {j})) 90. (3.15) 


Let P44:(t) = det (I — t&4,4°.0| Ho(K .(A, A’))). The short exact sequence (3.15) 
gives 
Pag — y(t) 


Py a(t) = : 
i Pauty.a'- ty) 


Induction on |A’| then implies 


Py alt) = TT Po", (3.16) 
Cc 


where | |¢ denotes a product over all subsets C ¢ S’ such that AS CC AU A’. 
We summarize these results: 


Lemma 3.17. Let feF,[x;,....%q.(%1--. x,) 1] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin and p ¥ det(a;;). For all A & S' and 
A’ < S’ — A, the complex K ,(A, A’) is acyclic in dimension > 0. Furthermore, 


Py a(t) m= I] P(t) see 


ASCEAVA' 


hence P,,4/(t) is a polynomial in Q(C,) [t] of degree 
(-— DS yp cccacal — DI — Cl)! Vf) and, if p is sufficiently large (depending 
on A(f)), all of its reciprocal roots are algebraic integers pure of weights <n —|A\|. 


Corollary 3.18. With the notation and hypotheses of Lemma 3.17, 


P(t) = I] Pais:—alt), 


AcS’ 


where P(t) = P(t) is as defined in Theorem 2.15. 
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Proof. By (3.16) we have 
I] P4s'- a(t) = I] I] P(t) 9" 


AcS’ ASS'ASCSS’ 


Il Il P(t) 1ylelial 


CsS'ASC 


= [] Pele." 


ccs’ 

= Ps (t) 
since ),--(— 1)'4' =0 if |C| >0. 
Remark. What Corollary 3.18 reflects, and what one can show with only slightly 
more effort (using (3.15)), is that 

H,(K .(@)) = @ Ho(K .(A, S’ — A)). 
Ass’ 
The main result of this article (Theorem 1.10) will be a consequence of the 

following: 


Theorem 3.19. Let feF,[x,,...,X,, (x, ...X,) '] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin. For p sufficienily large (depending on 
A(f)), the reciprocal roots of P4,s:~ 4(t) are algebraic integers pure of weight n — | A|. 
Remark. Let o, be the face of dimension n — |A| of A(f) which lies on (),_, H;. 
Then Lemma 3.17 implies that P, 5--4(t) is a polynomial of degree v(o,). Thus 
Theorem 1.10 is a consequence of Corollary 3.18 and Theorem 3.19. 


Proof of Theorem 3.19. Let A be the product of the reciprocal roots of P45 4(t) 
(so AEQ(¢,) by Lemma 3.17). If p is sufficiently large, then by Lemma 3.17 


|A| < /q"- Aone (3.20) 


for each archimedian absolute value on Q({,). It is well known that at all primes 
| + p, A has trivial valuation. Hence if we can show 


|Al, < /4 —(n—|Al)v(o,) (3.21) 


for every normalized nonarchimedian absolute value on Q(C,) lying over p, then 
the usual product formula for Q(¢,) will imply that 


1 
|A| iat ndash Stel q’- |Al)¥(o4) 
rai, V4 
Thus each reciprocal root of P, 5 — 4(t) must have weight exactly n — | A|. 
The proof of (3.21) will be the object of the next two sections. 


§4. p-Adic estimates 


The Newton polyhedron can be used to define a filtration on certain rings. Let 


R =F,[x"|ueM(f)]. (4.1) 
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The weight function w defines an increasing filtration on R by setting for ie Z, 


Ri » b,x" R|w(u) < i/M for all u with b, + of (4.2) 


When A C S’, this induces in the obvious manner filtrations on the subrings 


Ry =} DbsteRI =oitue ah. (4.3) 


ie A 


Associated to each of these filtered rings is a graded ring R, = @jez, R {/’, where 
RY” = Raym/Ravi-1ym- The rings R, and R, are identical as F,-vector spaces, 
but multiplication in R, obeys the rule 


xh xe’ uss 


x“*” if u and wu’ are cofacial 
(4.4) 


0 otherwise . 
Let fy, = )j=1 4jX;Of/Ox,;ER, and let fyi = 04°f,,ER4.1. Note that fy =0 

if ic A. Denote by fy, (resp. ff) the image of fi, (resp. fy) in R (resp. R,). 
Lemma 4.5. Let fe F,[X;,...,Xq,(X,-..% ,) '] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin and p ¥ det (a;;). For any subset A Cc S’, 


the set { fi Jigs , taken in any order forms a regular sequence on R ,, hence the Koszul 
complex K (Ry, { fit }iea) is acyclic in positive dimension. Furthermore, 


dimy Ho(K .(R4. {fit }iea)) = (n — [ANI H(G) , 
where o, = A(f)A(()ie4 Hi). 


Proof. The hypotheses imply that f, is also nondegenerate and that A(f,) is also 
simplicial with respect to the origin. Since f7: = (f,)y,. the argument of Lemma 3.1 
shows that one can simply repeat the proof of [1, Theorem 2.14]. 


One defines 6;: R,7R Av {j 48 in (3.2). For A’ € S’ — A, this allows us to define, 
as in 6. 6), jabcetabhiues K .(A, A’) of the Koszul complex 
K w= 'K (Ry, {Sit }iea). Proceeding as in the deduction of Lemma 3.17 from 
Lemma 3.11, we deduce: 
Lemma 4.6. Let feF,[x,,...,X,,(x,...X,) '] be nondegenerate and suppose 


A(f) is simplicial with respect to the origin and p x det(a;;). For all AS’ and 
A’ © S’ — A, the complex K .(A, A’) is acyclic in dimension > 0. Furthermore, 


dimy, Ho(K (A, 4’))=(— 141 YY (= 1" — |Cl)! (oe) . 


ASCSAVA' 


In particular, 
dim, Ho(K .(A, S’ — A)) = v(o,) . 


Set Rua’ = ( \jea’ (ker 0; |R,). By Lemma 4.6, 
H,(K .(A, A’)) = RaalD read Raw _{; 1S a  finite-dimensional graded ring. 
Let a;(A, A’) be the dimension over F, of the graded piece of degree i/M of 
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H,(K .(A, A’)). It can be shown (as in [9, Lemma 2.9] and [3, Lemma 1.5]) that 
a,(A, A’) = 0 for i> (n —|A|)M. 


Lemma 4.7. Let feF,[x,,...,X,,(x,-..X,) '] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin and p ¥ det (a;;). The Newton polygon of 
the polynomial P, 4(t) with respect to the valuation ord, lies above the Newton 
polygon of the polynomial []\"4"™ (1 — qi! t)*"4-4) and their endpoints coincide. 


Proof. This is proved by the method used in [1, Theorem 3.10]. The coincidence of 
the endpoints, which was not proved in [1], follows as in [5, paragraph preceding 
Theorem 7.1]. 

It follows that the coefficient of the highest degree term of P, ,-(t) has ordinal 


(with respect to the valuation ord,) equal to ol ite ™ a,(A, A). We do not know 


how to evaluate this explicitly in general, since we do not have a formula for 
a;(A, A’). The main point of this section is that we can evaluate it in the case where 
A’ = § — A, which will be sufficient to establish (3.21). 


Theorem 4.8. Let feF,[x,,...,X,, (x, .-.X,)~'] be nondegenerate and suppose 
A(f) is simplicial with respect to the origin and p ¥ det(a;;). Then 


a,(A, S’ — A) = Qn —\a)ym — iA, Ai — A) . 


Since " 4™ a,(A, S’ — A) = deg P,,s'- 4(t) = v(o,), we have as an immediate 
consequence 
(n |AIM 3 A| 


Y a4,’ — A) =~ v(o,), (49) 


i=0 
which establishes (3.21). 


Proof of Theorem 4.8. Fix A ¢ S’ and consider the complex K .(A, S’ — A). Since 
this complex is acyclic in dimension > 0, we have for i= 0,1,...,nM 


n—|A| 
aA, S’— A)= ¥ (—1)!dimy K,(A, 8’ — Ay’, (4.10) 

1=0 
where K,(A, S’ — A)“/M~ denotes the homogeneous part of degree i/M — 1 of 
K,(A, S’ — A). From its definition, we see that K ,(A, S’ — A) (as F,-vector space) is 
identified with @rcs_a(() 


[T\|=! 


(ker 0; | R,)as F,-vector space has basis equal to the set of all monomials x” such 
that ue(M(f) 0 (()je4 Aj) — (Ujes-caurn H,)- Let W,(l) be the number of such 
monomials having weight //M. Then 


dim, K,(A, S’ — A)“™~? = = W,(i — 1M), (4.11) 


jes’ (av 7) (Ker ;|R4)). Furthermore, ()<¢5-—(4u7 


a,(A, S’ — A) = "(= ¥ W,(i- IM). (4.12) 


TSS-A 
=! 
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Note that this sum may be truncated at / = greatest integer in i/M, since W;(/) = 0 
for | < 0. 

The desired result is trivial when A = S, so we assume A + S. The main lemma 
required for the proof of Theorem 4.8 is the following. 


Lemma 4.13. Suppose that T&S — A + & and r is an integer, OSr<M —1. 

(a) There exists a polynomial p7,,(x)€ Q(x] of degree n —|A| — 1 such that for 
1>0,/=r (mod M) we have W,(I) = pr,,(I). 

(b) If r’ denotes the unique integer, OS r’ S< M—1, such that r+r’'=0 
(mod M), then ps — (4. r(x) = (— 1)"~ 4" "pr — x). 

(c) One has 


if TAS’ + @ and AVU(TOS') +S’ 
if TAS' + @ and AV(TOS')=S' 
Pr.o(0) = n—|A|-—1 . , , 
(-1) if TAS’ = @ and A+S 
14+(-1)"-S'-! if TAS’ =@ and A=S' 
We postpone the proof of Lemma 4.13 until the next section and continue with 
the proof of Theorem 4.8. Since a;(A, S’ — A) = 0 for i >(n—|A|)M, equation 
(4.12) and Lemma 4.13(a) imply that 


n—|A| 


:. (— 1)! Y Pr,(x —IM)=0. (4.14) 
1=0 


TSS-A 
IT|=1 


We consider two cases, according as to whether i is or is not divisible by M. First fix 
r, 1Sr<M-—1, and let i=r(modM). Let s be the greatest integer in i/M. 
Equation (4.14) implies 


n—|A| 


L(-1! YL pree—IM)= YY (-1)'*! Y pr(x — 1M). (4.15) 
l=0 


TSS-A l=s+1 TSS-A 
IT| =I 


Applying Lemma 4.13(b) to the right-hand side of (4.15) gives 


¥(-1! YY pr,(x — 1M) 
=0 


TSS-A 
|T| =! 


l 


n-|A| 


a ee I Gok i ae 


l=s+1 TSS-A 
|T|\=n-|A|-lI 


(4.16) 


Evaluating at x = i and using (4.12) and Lemma 4.13(a) shows immediately that 
a,(A, S' — A) = Aq _ jam —i(A, S’ — A). 

Now consider the case r = 0 so that i = 0(mod M) and s = i/M. We would like 
to evaluate (4.16) at x =i as before, but one must be slightly careful because 
Lemma 4.13(a) need not remain valid when /=0. Suppose first that i + 0, 
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(n — |A|)M. One has by (4.12) and Lemma 4.13(a) that 


s=1 


a(A, S’'— Ay= ¥(-1)' ¥Y pri-—IM)+(-1% ¥ W,(O) 
1=0 TSS-—A Te$-4 
IT] =1 |T|=s 


n—|A|—s-1 
Gn—jaym-(A,S'— AV= Ye (- 1) Pr ((n — |A|)M —i—IM) + 
A 


1=0 ToS- 
|T| =! 


(—1-"-" YW). 
TSS-A 
|T|=n—-|A|-—s 


The result then follows from (4.16) evaluated at x = i, Lemma 4.13(c), and the 
observation that for T< S — A + @, 


0 if S+AUT’ 


; (4.17) 
1 if S=AvUT'. 


W,(0) = } 
From (4.12) and (4.17) one has 


0 if S’+A 
1 if VS=A. 


a)(A, S’ — A) = 


(4.18) 


Evaluating (4.12) at i=(n—|A|)M and (4.14) at x =(n—|A|)M and using 
Lemma 4.13(a) gives 


Ay —\4m(A, S’ — A) = (— 1)"~'4'(Ws_4(0) — Ps-4,0(0)) - 
The desired equality now follows from (4.17) and Lemma 4.13(c). 


§5. Proof of Lemma 4.13 


To prove Lemma 4.13 we introduce some auxiliary functions. For T ¢ S$ — A, set 
T’' = TOS". Define W,,(I) to be the number of monomials x" of weight 1/M such 
that ueM(f)O((\jeaurH)) and let W,(I) be the number of monomials x” of 
weight |/M such that ue(M(f)0(()jeaurHj)) — Ujes-(aury Hj. We have the 
following relationships. 


Lemma 5.1. For T<¢ S —A+@Q@, 
W,(l)= > W,(l) 


BcT’ 


WAD= LY  (-1)"'W,()). 
BcS'-(AvuT’') 
Proof. For each ue(M(f) A(()jeaH;)) — Ujes:-aunH,;, there is a unique subset 
BT’ such that ue(M(f)A((\jeausH;)) — Ujes:-auayHj. This proves the first 
identity. The second identity is proved by a standard inclusion-exclusion argument. 
These auxiliary functions satisfy the following. 
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Lemma 5.2. Suppose that T<© S — A+ QQ and r is an integer, OS r<M-—1. 
There exist polynomials pr,,(x), pr,-(x)€ QLx], both of degree n —|AUT’| — 1 such 
that: 

(a) For 1>0,1=r (mod M), we have W,(l) = pr,,(l) and W,(l) = pr,,(I). 

(b) If r’ denotes the unique integer, 0S r’ S M —1, such that r+r’'=0 
(mod M), then pr,,-(x) =(— 1)"~4°"'~'pr,(— x). 

(c) One has 


1 f AUT’sS’ 
Pro) =<{90 if AUT'=S’ and n—|S'| is even 
2 if AUT’=S' and n—|S'| is odd 
| ieee & Lee ae 
Pr,o(0) = (0 if AUT’ =S'’ and n—|S'| is even 
: if AUT’ =S' and n—|S’'| is odd . 


Remark. Note that Lemma 4.13 now follows in a straightforward manner by 
substituting the results of Lemma 5.2 into the formulas of Lemma 5.1. 


Proof of Lemma 5.2. Suppose first AU T’ = S. Then W,,(/) = W,() = 0 for] > 0, 
so the equalities in (a), (b), and (c) are valid with p 7, and p,7,, both taken to be the 
zero polynomial. So the lemma is true if one assigns the degree — 1 to the zero 
polynomial. 

Now suppose AUT’+S. Let Hg be the linear variety ()j. pH;, let 


Az = A4(f)O Hg, and let (I/M)A, denote the dilation of 4, by the factor |/M. Let 
jp(l) be the number of lattice points in (//M) Ag, ig(! ) the number of lattice points in 
the interior of (/M)A,, and h,(l) the number of lattice points of the boundary of 
(l/M) Ag. It is straightforward to check that for | > 0, 

W)=hrl)— YL ipl) (5.3) 


AUT'cBcS’ 
WrVY=ha r+ YL (- 1-4 GR), (5.4) 
AuT'cBcS’ 
where we use the notation A U T’ c Bto mean that A UT’ is a proper subset of B, 
i.e. AU T’ + B, and where we make the convention that j,(/) = i,{l) = 1. 
Ehrhart [6] proves that there exist polynomials ig ,(x), js,-(x)€QLx] of degree 
n—|B| and h,(x)EQ[x] of degree n—|AUT’|—1 such that for />0, 
| =r(mod M), 
ip(l) = ig,-(I) 
ja(l) = jn,r(l) 
hac rl) = h,(1) . 


In view of (5.3) and (5.4), this implies the existence of polynomials pr.,(x), 
Pr.r(x)€QLx] satisfying Lemma 5.2(a). In addition, Ehrhart ([6, Corollaire A.2 
of Chapitre 6], [7]) shows that 


ip,e-(x) = (— 1)"~""\jn,( — x). (5.5) 





Exponential sums on (G,,,)” 


Since h,(x) = jaur(x) — inc r.r(x), we have 
h,(x) = (— 1" 4°!" "h(— x). 
Starting with (5.4) and applying (5.5), (5.6), and (5.3) we get 
Pre Q=hO+ Yo (- pF 4erys(l) 


AUT'cBcS’ 


=(— 1 +. ee ee 


AuT'cBcS’ 


=(—1)"-4eT-'ph( —D)—(-— yr 4a! p ig,-( — 1) 


AUT’cBcS’ 


=(— 1" 4-"-'5,(-)), 
which establishes Lemma 5.2(b). 


Finally, Ehrhart [6, Remarque 2 following Corollaires 4.2] calculates that 
j,o(0) = 1 for all B, so (5.5) implies ig o(0) = ( — 1)"~'?' and 


0 if n—|AUT"| is even 
h,(0) = 
0(0) . if n—|AUT" is odd . 
Lemma 5.2(c) now follows from (5.3) and (5.4). 
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Let X be a smooth geometrically connected curve over the field R of real numbers. 
We denote by S the set of connected components of X(R) for the Euclidean 
topology and by s its cardinality. Let R(X) be the function field of X. In 1934, E. 
Witt proved that the subgroup of the Brauer group of the field R(X) consisting of 
classes which are unramified on X is a finite group isomorphic to (Z/2)° ([28], Satz 
III’, see also [12]). For a curve X over R, the Brauer group of R(X) is 2-torsion and 
hence coincides with the étale cohomology group H?(R(X), Z/2). Thus Witt’s 
theorem may be rephrased as saying that the unramified subgroup of the étale 
cohomology group H?(R(X), Z/2) is isomorphic to (Z/2)°. (We refer the reader to 
§1 for the definition of the unramified cohomology classes.) 

Thus, the following theorem, which is the main result of this paper, appears as 
a natural extension of Witt’s theorem to higher dimensional varieties. 


Main theorem. Let X/R be a smooth quasi-projective geometrically connected 
variety over R, of dimension d. Let S denote the (finite) set of connected components 
of the topological space X(R). Then for any n2 d + 1, the subgroup of the étale 
cohomology group H"(R(X ), Z/2) consisting of classes unramified on X is isomorphic 
to (Z /2)°. 


In this theorem, we do not demand that X be projective or that X(R) be 
compact. 

If X is smooth and projective over R, it is a known fact that the number of 
connected components of the topological space X(R) is a birational invariant 
({11], Theorem 13.3). The above theorem shows that this invariant, a priori defined 
via topology, coincides with the Z/2-rank of the unramified cohomology subgroup 
of H4*'(R(X), Z/2), a birational invariant of a purely algebraic nature. 

Another consequence of the theorem is the finiteness of the unramified sub- 
group of H"(R(X), Z/2) for n = d + 1. This finiteness has already been used by the 
second author [20] in proving the finite generation of the Witt group of some affine 
threefolds. (In the range 3 <n <d, we do not know whether the unramified 
subgroup is finite.) 
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To prove the theorem, we first construct a map h, from the unramified 
subgroup of H"(R(X), Z/2) to the group of continuous functions on X(R) with 
values in Z/2 (see §2.1). We call the map h, the mod 2 signature map (of level n). Its 
definition uses the Bloch/Ogus results [3] on étale analogues of the Gersten 
conjecture in algebraic K-theory (as established by Quillen). The main ingredients 
to prove that, for n = d + 1, the map h, is an isomorphism are: 


— The results on quadratic forms over fields, beginning with the work of Pfister 
[21] and further developed by Arason, Elman, Jacob, Lam. The survey [1] will 
be our basic reference. 

— Mahe’s result [17] on the separation of real connected components by means of 
signatures of quadratic spaces. 


For the convenience of the reader, the relevant material is reviewed in §1. 

The results of [1] are enough to prove injectivity of h, (n 2 d + 1). The proof of 
surjectivity is more delicate and requires a combination of [1] and [17] (see §2.3). 
Once connected components are replaced by semi-algebraic components (as de- 
fined by Knebusch, Delfs, Coste/Roy) the theorem makes sense over an arbitrary 
real closed field R, and we actually prove it in this more general context. (For 
curves, this extension of Witt’s theorem is due to Knebusch ([15], p. 56).) Our proof 
relies on the notion and properties of the real spectrum of a ring, as developed by 
Coste and Roy ([4], chap. 7). This is not only a matter of elegance: even for the 
usual real field R as a ground field, it would be cumbersome to avoid using this 
notion. 

Nevertheless, in the special case where R = R and moreover X(R) is compact, 
one may, as in [5], use the Stone—WeierstraB approximation theorem and show 
that every element of the unramified subgroup of H"(R(X), Z/2), n=d +1, is 
acup-product { ff — 1,..., — 1}, where fe R(X) is invertible on X (R) (cf. §2.4). In 
§3, we use these explicit representatives to prove that the Bloch/Ogus spectral 
sequence [3] degenerates for smooth compact real surfaces. 

We give two applications of this degeneration. First, if the smooth compact real 
surface X satisfies a simple geometric condition (which is always fulfilled if X is 
affine), the degeneration implies that (the 2-torsion subgroup of) the Brauer group 
of X separates the real connected components of X(R): the maph, is surjective 
(Proposition 3.1.2). 

Second, the degeneration result together with some K-theoretic facts leads to 
lower bounds for the Z/2-rank of the étale cohomology groups H?,( X, Z/2) of 
a smooth compact real surface X in terms of the number s of connected compon- 
ents of X(R), such as: 


rank H3(X, Z/2)>2s—1. 


These estimates are refinements of those provided by Smith theory. 

For a real rational surface X, we can go further and compute the exact rank of 
H3(X, Z/2). This gives a new approach to the known Galois structure ({14], [26], 
[27]) of the Picard group of such surfaces. 
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§1. The background 


1.1. The real spectrum and a theorem of Mahé 


For a commutative ring A, the real spectrum Spec, A is the set of pairs (p, <) 
where p is a prime ideal and < denotes an order on the residue class field x(p) of 
the local ring A,. Thus, given a point (p, <) of Spec, A, there is an associated 
homomorphism A — R?, where R? denotes the real closure of the ordered field 
(x(p), <). 

There is a natural topology on Spec, A (cf. [4], Chap. 7). If F is a field, Spec, F 
coincides with the space of orderings of F, equipped with the Harrison topology, 
used in [1]. 

Assume that A is of finite type over a real closed field R, and let X = Spec A be 
the usual spectrum, which is a variety of finite type over R. One may then define the 
semi-algebraic components of the algebraic set X(R) of R-points of X ([4], 2.4 and 
7.5). There is an obvious inclusion X(R) < Spec, A. Restriction defines a bijection 
between the connected components of the topological space Spec, A and the 
semi-algebraic connected components of X(R) ([4], 7.5.1). When R is the real field 
R, these semi-algebraic connected components coincide with the connected com- 
ponents of X(R) for the Euclidean topology ([4], 2.4.5). 

Assume that A is of finite type over R, that it is integral and that X = Spec A is 
smooth over R. Let R(X) be the field of fractions of A. Then the image of 
Spec, R(X) under the natural inclusion Spec, R(X) G Spec, A is dense in Spec, A 
((4], 7.6.1). 

Let X = Spec A be an affine scheme, and let W(A) be the Witt ring of quadratic 
spaces over X. We recall that a quadratic space is a projective A-module E of finite 
rank together with a symmetrical isomorphism of E with its dual. 

There exists a signature map from the Witt ring of A to the ring of Z-valued 
continuous functions of Spec, A: 


sgn: W(A) > @ (Spec, A, Z) , 
which generalizes the signature map for fields ([1]). 


Theorem 1.1.1 (Mahé [17]). The cokernel of the signature map is a 2-primary 
torsion group. More precisely, if Spec, A = U, U U, is a decomposition as a union of 
two disjoint open sets, there exists an integer N and a quadratic space E over X whose 
signature over each point of U,, resp. U,, is 2%, resp 0. O 


1.2. Etale cohomology 


Throughout this paper, by cohomology, we mean étale cohomology (dropping the 
subscript “ét” in most places), the main exception being the Zariski cohomology of 
the Bloch-Ogus sheaves (see below). 

If F is a field, H"(F,-) will denote étale cohomology of Spec F, i.e. Galois 
cohomology of the absolute Galois group Gal (F,.,/F). 

We shall often be concerned with the group H2,(F, Z/2)(char(F) + 2), which 
we shall abbreviate to H"(F). Given elements a; (i = 1, . . . , n) in the multiplicative 





84 J.-L. Colliot-Théléne and R. Parimala 


group F* of the field F, we shall write {a,,...,a,} for the cup-product of the 
classes of the a; in F*/F*? ~ H'(F, Z/2). 

Similar conventions will hold over a scheme X in which 2 is invertible 
(H"(X) = H"(X, Z/2) etc.) 

The following proposition is an easy consequence of a theorem of Serre’s [24]. 
It was first noticed by J. Ax and its proof was brought to our attention by B. Kahn. 


Proposition 1.2.1. Let X be an integral variety over a real closed field R, and let d be 
the dimension of X. Assume X(R) = ¢. Then the cohomological dimension of the 
function field R(X) is equal to d. 


Proof. Let G be the absolute Galois group of R(X), and let H < G be the absolute 


Galois group of C(X), where C = R(,/ — 1). It is known that the cohomological 
dimension of H is equal to d. Since C(X)/R(X) is of degree at most 2, this implies 
cd,G = d for p + 2. By Artin’s results, the hypothesis X(R) = @ implies that the 
field R(X) cannot be ordered. Thus, by the Artin—Schreier theorem, the group 
G does not contain any element of order 2. According to a theorem of Serre [24], 
this last fact implies cd,G = cd,H, hence cd,G=d. O 


Remark 1.2.2. For X as in the proposition, one may give another proof of 
H"(R(X), Z/2) =0 for n>d by combining Proposition 2.4 and Theorem 1.11 
of [1]. 


Remark 1.2.3. The above proposition proves the main theorem in the case where 


X(R) = @. 


If R is a real closed field, it is easily shown that H"(R) = H3,(R, Z/2) is isomor- 
phic to Z/2, the non-zero element being the n-fold cup product {— 1,..., — 1}. 
Let K be any field. If «¢ H"(K) and pe Spec, K, the image «, of « under the natural 
map H"(K) > H"(R°) is denoted by hg,(«) ({1]). The following theorem is easily 
deduced from ([1], Proposition 2.4), together with Proposition 1.2.1 above (cf. [1], 
proof of Corollary 2.8). 


Theorem 1.2.4. Let R(X) be a function field of transcendence degree d over a real 
closed field R. For n>d, the map hg,: H"(R(X))— @(Spec, R(X), Z/2) is an 
isomorphism. 


1.3. Unramified cohomology 


Let X be a smooth integral variety over a field k, and let k(X) be its function field. 
Assume char(k) + 2. Let #"” be the Zariski sheaf associated to the presheaf 
Ur H"(U) = H"(U;,, Z/2). Let Oy p denote the local ring of the scheme X at the 
point P and let «(P) be its residue field. The following theorem is a consequence of 
the results of Bloch and Ogus ([3]): 


Theorem 1.3.1. The following subgroups of H"(k(X )) coincide: 
(a) The group H°(X, #") of global sections of the sheaf #". 
(b) The group of elements « in H"(k(X)) such that for each point P of the scheme 
X, there exists ape H"(Oy p) = H3,(Oy,p, Z/2) whose image in H"(k(X)) 
coincides with «. 





Real components and étale cohomology 85 


(c) The group of elements « in H"(k(X)) such that for each codimension 1 point 
P of the scheme X, there exists ape H"(Ox p) whose image in H"(k(X)) 
coincides with «. 

(d) The group of elements a in H"(k(X)) such that for each codimension 1 point 
P of the scheme X, 0p(a)=0, where 0p(a) denotes the image of « in 
H"~'(x(P)) under the map @> arising in the Bloch-Ogus complex. 


Moreover, given « and P as in (b) or (c), the element ape H"(Ox, p) is uniquely 
defined, the map H"( Ox, p) ~ H"(k(X)) being injective. O 


The subgroup H°(X, #") < H"(k(X)) is called the unramified subgroup of 
H"(k(X)) with respect to X. We shall sometimes denote it by H",(k(X), X). 
As an easy application of Theorem 1.3.1, we have, 


Proposition 1.3.2. Let X be a smooth, proper, integral k-variety, and let k(X) be its 
function field. The group H°(X, #") = H?,(k(X), X) coincides with the subgroup of 
H"(k(X)) consisting of elements « such that for each rank one discrete valuation ring 
A containing k and having k(X) as its field of fractions, the boundary 6 ,(«) vanishes in 
H"~'(x(A)), where x(A) denotes the residue field of A. O 


In particular, the group H7,(k(X), X) is a k-birational invariant of smooth 
projective integral k-varieties: it does not depend on the particular smooth proper 
model X/k of the function field k(X)/k. We may thus denote it simply by 
H jr(k(X )/k) (cf. [8] §1). 

For further use, we mention the following lemma (see [8], Proposition 1.3 and 


[20], §1). 


Lemma 1.3.3. Let A be a discrete valuation ring, let K be its field of fractions and let 
K be its residue field. Assume that 2 is invertible in x. Let a; (i= 1,...,n) be in K*. 
Assume that all a; are units in A for i > 1, let «,;€«* be their images in x*, and let r be 
the valuation of a,. Then 


a A{a;,...+a&)) = riley... 0H *e). 0 
Proposition 1.2.1 has the following consequence: 


Proposition 1.3.4. Let X/R be a smooth integral variety over a real closed field R, and 
let U < X be a non-empty Zariski open set such that U(R) = X(R). Let d be the 
dimension of X. Then for n= d + 1, and any i= 0, the restriction map induces an 
isomorphism 


H'(X, #") > H'(U, #"). 


Proof. For any point Pe X \ U, the closure Zp of P contains no R-point. Let R(P) 
be the residue field of X at P (which is the function field of Zp). By Proposi- 
tion 1.2.1, H*(R(P)) = 0 for any k > dim Zp. This implies that the global sections 
of the Bloch—Ogus resolutions of the sheaves #" over X and over U coincide as 
soonasn=d+l. O 


Corollary 1.3.5. Let X /R be a smooth geometrically connected variety of dimension 
d, and assume that X(R) is compact. Then for any n2d+1, the subgroup 
H°(X, #") of H"(R(X)) coincides with H7,(R(X)/R). 
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Proof. By Hironaka’s desingularization theorem, one may realize X as a Zariski 
open set of a smooth proper R-variety X,. Since X(R) is compact and dense in 
X .(R), it coincides with X ,(R). It only remains to apply the previous proposition. 
(For X quasi-projective, one could also argue (cf. [4], 10.2.5) that X(R) compact 
implies that any real valuation of R(X) trivial on R has its centre on X). O 


1.4. Quadratic forms over fields 


For any field k (char (k) + 2), let W(k) be its Witt ring and I"k < W(k)(n = 0) be the 
powers of the fundamental ideal Ik of forms of even rank. The ideal J"k is spanned, 
as a group, by the n-dimensional Pfister forms «€a,,...,a,)= 
<1, —a,>@... @<1, — a,>(a,;Ek*). As explained in [1], Sylvester’s theorem 
yields a signature map: 
sgn: W(k) > @ (Spec, k, Z) 
which induces maps 
sgn,,: 1"k + @(Spec, k, 2"Z) . 
These maps are compatible for various n with respect to inclusions and thus induce 
maps 
I"k/I"**k + @(Spec, k, 2"Z/2"*!Z) =~ @(Spec, k, Z/2Z) . 
On the other hand, one checks that the map from I"k to 1"**k given by multiplica- 
tion by the form € — 1) = <1, 1) induces a commutative diagram: 


I"k/I"**k —+ @(Spec,k, Z/2Z) 
1 @«-1) {= 
I"**k/I"*?k ~=— @(Spec,k, Z/2Z) . 
We refer to [1], §2, for the proof of the following theorem. 


Theorem 1.4.1. Let K = R(X) be the function field of a variety X of dimension d over 
the real closed field R. Letn2=d + 1. 


(a) Multiplication by <1, 1) induces an isomorphism 


PK = 1***K. 
(b) If K is not formally real, then I"K = 0. 
(c) The map I"K/I"** K + @(Spec, K, Z/2Z) defined above is an isomorphism. © 


1.5. Quadratic forms over real function fields and cohomology 


Let A be a rank one discrete valuation ring, let K be its field of fractions and x its 
residue field (char(x) + 2). Associated to a uniformizing parameter 7, there is 
a well-known second-residue homomorphism ¢6,: W(K)— W(x) which maps 
I"*! K to I"x for any n. As is easily checked, the subgroup Ker 0, does not depend 
on the choice of the uniformizing parameter 2. We shall therefore denote it by 
Ker 0,. 

If X is a normal integral scheme with 2 invertible in O, and with function field 
k(X), we shall define the unramified subgroup of W(k(X)) with respect to X as the 
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Walk(X)/X)= (| Kerds,< W(k(X)). 
Pex” 
Here P runs through all points of codimension 1 of X and Ap denotes the local ring 
of X at such a point: since X is normal, such a ring is a rank one discrete valuation 
ring. 
For n = 0, we define 


Tir(k(X)/X) = I"k(X) 0 War (k(X)/X) < W(k(X)) . 


Proposition 1.5.1. Let X be a smooth integral R-variety of dimension d and let R(X) 
be its function field. Let n= d + 1. 
(a) There exists a homomorphism 


e,: I"R(X) > H"(R (X)) 


which is uniquely defined by the requirement that it map the Pfister form 
«a,,..., 4,» to the cup-product {a,,..., a,}. 


(b) The homomorphism e, maps I",(R(X)/X) to H°(X, #") < H"(R(X)). 
(c) The mape,, induces an isomorphism 


I"R(X)/I"*! R(X) > H"(R(X)) , 


which is compatible with the isomorphisms of both groups with the group 
@ (Spec, R(X), Z/2), as recalled in 1.4.1 and 1.2.4. 


Proof. The proof of (a) and (c) is given in [1], §2. Let P be a point of codimension 
1 on X, and let A be the local ring of X at P. Let k = x(P) be the residue field of A, 
and let z be a uniformizing parameter of A. In order to prove (b), we only have to 
check that the following diagram is commutative: 


:I"R(X) — H"(R(X)) 
1 a, | @, 
Cn. 1" 'k(P) > H"""(x(P)) . 


Here the horizontal maps are well-defined according to (a) (the dimension of the 
function field x(P) is one less than that of R(X)), and the vertical maps are the 
residue maps for Witt groups and the boundary maps in the Bloch—Ogus context. 
Since J"R(X) is spanned as an abelian group by the Pfister forms ¢a,,..., a,» 
with all a; for i = 2 units in the discrete valuation ring A, the commutativity of the 
above diagram thus follows from the well known formula for the value of the 
residue homomorphism on such a form and Lemma 1.3.3. O 


en 


§2. The main theorem 


2.1. Mod 2 signatures on étale cohomology 


Let A be a commutative ring with 2€ A*. If(p, < ) is a point of Spec, A, there is an 
associated homomorphism from the residue field x(p) of Spec A at p to the real 
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closure R” of the ordered field x(p) and hence a homomorphism from the local ring 
A, to R?. Let a€ H"(A) = H?,(A, Z/2) be an étale cohomology class. There is an 
associated element «,¢Z/2, which is the image of a in H"(R?’) = Z/2. Thus 
a defines a map: 

h, (a): Spec, A > Z/2 


p>, 
Lemma 2.1.1. The map h,(«) is continuous, i.e. it is locally constant. 


Proof. We may assume n 2 1. If a, +0, then «, = {— 1,..., — I} gr. Changing 
aintoa —{—1,..., — 1},4,we may assume that «, = 0. If B denotes the strict real 
henselization of A at the point p of Spec, A, then «, = 0€ H"(B). By standard limit 
arguments, we conclude that there exists fe A, with f(p) > 0, a ring C, a prime ideal 
P of C, with an ordered residue field x(P), together with an étale map A, > C such 
that the contraction of P to A, is p, the extension x(P)/x(p) is finite, the order of 
k(P) induces the given order of x(p) and such that a, = 0€ H"(C). 

The map Spec C — Spec A being étale, the induced map g: Spec, C > Spec, A 
is an open map (Roy [22], Proposition 2.4). Since the point pe Spec, A belongs to 
the image of Spec, C, there exists an open set U < Spec, A which contains p and 
such that U c (Spec, C). At any point ge U c Spec, A, the fibre a, is trivial. O 


If A = K is a field, then the maph, coincides with the map hg, (cf. §1.1). 


Now if X = Spec A is a smooth integral affine variety over R, there is a natural 
map 


h,: H°(X, #2") + Gl (Spec, A, Z/2) 


from H°(X, #") to the set of maps from Spec, A to Z/2, which we now describe. 
Let (p, < )eSpec,A be a point of the real spectrum of A. Let A — R?” be the 
associated homomorphism from A to the real closure R? of x(p). Any element « of 
H°(X, #") < H"(R(X)) comes from a well-defined element a,€ H?,(A,). One then 
defines h,(x)eZ/2 = H"(R’) to be the image of «, under the natural map 
H3,(A,) > H"(R’). 


Proposition 2.1.2. Given any «€ H°(X, #"), h,(«) is a continuous map, i.e. it is 
a locally constant map. 


Proof. Let(p, < ) bea point of Spec, A. As in the proof of 2.1.1 we may assume that 
the image of (p, <) in Z/2 is zero. Easy limit arguments show that there exists an 
open affine neighbourhood Spec B of p in Spec A and an element ye H"(B) such 
that a and y have the same image in H"(R(Y)). Now given any point q of the 
smooth R-scheme Spec B, the restriction map H"(B,) > H"(R(X)) is injective acc- 
ording to Bloch and Ogus (see 1.3.1 above). Thus on the open set Spec, B < Spec, A 
the map h,(«) coincides with the map h,(y) defined above and the claim follows. O 


Thus, if X = Spec A is a smooth integral affine variety over R, we have a map 
h,: H°(X, #2") + @(Spec, A, Z/2) 


which we shall call the mod2 signature map. Composition with the inclusion 
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X(R) < Spec, A yields a map 

H°(X, #") > @(X(R), Z/2) . 
By the results recalled in 1.1, (resp. by trivial arguments if R = R) the continuity of 
each h,(«) on Spec, A implies that this map factorizes through (Z/2)°, where S is the 


set of semi-algebraic connected components of X(R) (resp. connected components 
of X(R)). We therefore have: 


Corollary 2.1.3. Let X be a smooth integral variety over the real closed field R, and 
let n be an integer. Let S be the set of semi-algebraic connected components of X (R). 
Taking fibres at points of X(R) yields a homomorphism 


H°(X, #") > @(X(R), Z/2) 
which factorises through (Z/2)°. O 


One easily checks that the map h, is functorial with respect to R-morphisms of 
smooth integral affine R-varieties. By the remark following Lemma 2.1.1, restric- 
tion to the generic point yields a commutative diagram: 


h,, 
H°(X, #")—> (Spec, A, Z/2) 


| | 


hg 


H"(R(X)) —~»@(Spec, R(X), Z/2) . 


2.2. Stability properties for the unramified Witt group 


Proposition 2.2.1. Let R be a real closed field, and let X be a normal integral 
R-variety of dimension d. Then for any n = d + 1, multiplication by <1, 1) induces an 
isomorphism 


Ti(R(X)/X) = Ine *(R(X)/X) . 


Proof. Let P be a point of codimension 1 on X. Its closure Y in X is an integral 
R-variety of dimension d — 1. Let z be a uniformizing parameter of the local ring of 
X at P. There is a commutative diagram: 


I"R(X) > 1"*! R(X) 


{ 1 
I"""R(Y) > I"R(Y) 


whose horizontal maps are given by multiplication by <1, 1) and vertical maps are 
given by 0,. Since n = d + 1, Theorem 1.4.1 ensures that the horizontal maps are 
isomorphisms. Hence multiplication by <1, 1> induces an isomorphism between 
the kernels of 6, on I"R(X) and on I"*' R(X). Applying this to all points of 
codimension | on X yields the result. O 


Proposition 2.2.2. Let R be a real closed field and X a smooth integral R-variety of 
dimension d. Let U < X be a non-empty open set. If for each point P of codimension 
1 of X not lying in U, the residue field of X at P is not formally real ( for instance if 
U(R)=X(R)), and if n2d+1, then the natural restriction maps 
Ti(R(X)/X) > 1%,(R(U)/U) are isomorphisms. 
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Proof. If P is a point of codimension 1 on X not in U, then the residue field «(P) is 
a non-formally real function field over R of transcendence degree d — 1. By 1.4.1(b), 
I"~1(«(P)) = 0, and hence the relevant residue map vanishes on J"~'(R(X)). O 


If X = Spec A is a normal, integral, affine scheme with 2 € A*, the image of the 
restriction map W(A)—> W(k(X)) lies in W,,(k(X)/X). In view of this remark, 
Mahé’s Theorem (1.1.1) implies the following 


Theorem 2.2.3. Let X = Spec A be a normal integral affine R-variety (R any real 
closed field). Let Spec,A =U, UU, be a disjoint union of open sets and 
Q; = U; Spec, R(X). Then, there exists an element ae W,,(R(X)/X) < W(R(X)) 
and an integer N = 0 such that sgn(a) is 2% on Q, andOonQ,. O 


2.3. Proof of the main theorem 


Theorem 2.3.1. Let R be a real closed field, and let X be a smooth integral 
quasi-projective variety over R, of dimension d. Let S be the set of semi-algebraic 
connected components of X(R). Then for any n= d + 1, the mod2 signature map 
yields an isomorphism 


H°(X, #") = (Z/2)8. 


Proof. Since X is quasi-projective and R is not algebraically closed, one may find 
a non-empty affine open set U = Spec A of X such that U(R) = X(R) ([S5], 1.5). 
Thus the semi-algebraic connected components of U(R) and of X(R) coincide. 
On the other hand, the condition n2d+1 implies that the inclusion 


H°(X, #") < H°(U, #") actually is an isomorphism (Proposition 1.3.4). Since the 
inclusion U(R) < Spec, A induces a bijection between the connected components of 
Spec, A and the semi-algebraic components of U(R), we are reduced to proving the 
following theorem. 0 


Theorem 2.3.2. Let R be a real closed field, and let X = Spec A be an affine, smooth, 
integral variety over R of dimension d. Let S be the set of connected components of the 
real spectrum Spec, A. Then for any n 2 d + 1, the mod 2 signature map on the real 
spectrum Spec, A yields an isomorphism: 


h,: H°(X, #2") ~ (Spec, A, Z/2) = (Z/2)$ . 


Proof. Let R(X) be the field of fractions of A. As in §2.1, there is a commutative 
diagram 
H°(X,4#")— (Spec, A, Z/2) 


{ | 
H"(R(X)) — (Spec, R(X), Z/2) . 


For n = d + 1, the bottom map is an isomorphism (Theorem 1.2.4). Hence for such 
n, the top map also is injective. 

Let now Spec, A = U, UU, be a decomposition into two disjoint non-empty 
open sets. Let Spec, R(X) = 2, UQ, be the trace of this decomposition on 
Spec, R(X). Since X is smooth, 2, and Q, are non-empty. By Theorem (2.2.3), there 
exists an integer N and an unramified element qe W,,(R(X)/X) such that 
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sgn (q) = 2" on Q, and sgn(q) = 0 on Q,. Multiplying q by some power of the form 
«1, 1) if need be, we may assume that q lies in 1",(R(X)/X). We then have N = n. If 
qeI4*}(R(X)), then, by Theorem 1.4.1(c), the highest power of the fundamental 
ideal of W(R(X)) in which q lies is detected by its signature. Thus, if N > n, 
Theorem 1.4.1(c) implies that q actually lies in ‘(R(X )) and hence in IN (R(X)/X). 
By stability Cees 2.2.1), there exists a form q,€1%,(R(X)/X) such that 
<1, 1>°%~"q, =q in IN(R(X)/X). We clearly have sgn(q,) = 2" on Q, and 
sgn(q,) =0 on Q,. Let « = e,(q,)€ H°(X, #") be the element given by Proposi- 
tion 1.5.1(a)(b). Part (c) of that same proposition implies h,(«) = 1¢Z/2 on Q, and 
h,(«) = 0€Z/2 on Q,. Since h,(«) is locally constant on Spec, A and Spec, R(X) is 
dense in Spec,A, X being smooth, we have h,(#)=1eZ/2 on U, and 
h,(a) =0eZ/2 on U,. 

Thus the injective map H °(X, #") > @(Spec, A, Z/2) is also surjective, and the 
theorem is proved. O 


2.4. The compact case 


If R = Rand X(R) is compact, we exhibit an explicit inverse to the signature map. 
This will be used in §3. 


Theorem 2.4.1. Let X be a smooth integral quasi-projective variety of dimension 
d over the real field R such that X(R) is compact. Let S be the set of connected 
components of X(R). Let n= d + 1. Then 


i) For any ¢€@(X(R), Z/2), there exists a function f,€ R(X) which is invertible on 
X(R) and such that for x € X(R), f,(x) > 0 if and only if e(x) = 

ii) The cup-product { f,, —1,..., — 1}€H"(R(X)) does not depend upon the parti- 
cular choice of f,. The map e++{f,,—1, ...,—1} is the inverse of the mod 2 
signature map. 


Proof. The same arguments as in the proof of Theorem 2.3.1 allow us to restrict to 
the case where X is affine, say X = Spec A. 


Let X(R) = U, UU, be a decomposition into two disjoint non-empty open sets 
such that ¢|y, = 1, ely, = 0. According to the Stone—WeierstraB approximation 
theorem, there exists a function fe A which is very close to — 1 on each point of U, 
and is very close to 1 on each point of U,. This proves i). 

Let P be a point of codimension 1 of the scheme X. The closure Y c X of P is 
an integral R-variety of dimension (d — 1). Its function field R( Y) is the residue field 
K(P) of X at P. If R(Y) is formally real, the set Y(R) is not empty (Artin-Lang 
theorem, see [4], 4.1.2). Since f is invertible at each point of X(R), this implies that 
f is invertible at P. Since all entries in the cup-product « = { f; — 1,. — 1} are 
units, we conclude that 64 («) = 0. On the other hand, if R(Y) is not formally real, 
then H"~'(R(Y)) =0 (Proposition 1.2.1) and hence certainly 04,(«) = 0. Thus 
a= tf —1,. — 1}e€H"(R(X)) belongs to H°(X, #"). The fibre of « at points 

fii wi , — 1} =1eZ/2 and it is {1, —1,..., —1} =0EZ/2 at 
points of U,. Thus h,(a) = = ¢. The injectivity of h,,n = d + 1 (Theorem 2.3.1) implies 
assertion ii) of the theorem. 0 





92 J.-L. Colliot-Théléne and R. Parimala 


Remark 2.4.2. Theorem 2.4.1 holds more generally for any archimedean real closed 
ground field R. On the other hand, for any non-archimedean real closed ground 
field, Schiilting ([23], §5) has examples of surfaces such that functions do not 
separate semi-algebraic components and Theorem 2.4.1 does not generalise to such 
ground fields. 


Remark 2.4.3. If X(R) is not compact, the theorem breaks down ([5], 1.8.1). 

Remark 2.4.4. For X over R as in Theorem 2.4.1, one wonders whether the 
map H°(X, #4) > H°(X, #4*") given by cup-product with { — 1} is surjective. In 
particular, it is true that the elements of H°(X,#“) separate the connected 
components of X(R)? For curves, this easily follows from the divisibility of the 


Jacobian of the smooth projective model of X,. For real surfaces satisfying some 
geometric conditions, this question has a positive answer (Proposition 3.1.2). 


§3. Real compact surfaces 


3.1. Degeneration of the Bloch—-Ogus spectral sequence 
From the local global spectral sequence 

EX = H"(X, #%)=>H"(X) , (*) 
where H"(X, #%) = H"(Xz,,, #%) and the existence of (flasque) Gersten resol- 
utions for the Zariski sheaves #4, as proved by Bloch/Ogus [3] (which implies that 


the non-vanishing terms of the spectral sequence ( * ) are concentrated in the sector 
p <q), one immediately gets the exact sequence: 


0- H'(X, #”) > H3(X) > HX, #) > HX, HH?) H*(X). ( *« ) 


Let CH?(X) denote the Chow group of codimension 2 cycles modulo rational 
equivalence. The Bloch—Ogus resolution of the sheaf #7 yields an identification 


CH2(X)/2 ~ H?(X, #7”). 


Presumably, one may check that the map H?(X, #7) — H*(X) in the above 
sequence is induced by the cycle map CH?(X)— H*(X) coming from étale co- 
homology, but this is not needed in the sequel. 

Whenever the differential d, in the sequence ( ** ) vanishes, one expects interest- 
ing consequences for CH?(X). However, this differential does not always vanish. 
The complement of a general quartic in Pé is an example. P. Salberger informs us 
that d, does not vanish for some smooth projective rational surfaces without 
rational points over certain non-algebraically closed fields. We ask the following 
questions: 


1) Is d, zero for smooth projective varieties over algebraically closed fields? 
2) Is d, zero for smooth projective surfaces over perfect fields provided they have 
a rational point? 

Here is one case where the differential vanishes: 
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Proposition 3.1.1. Let X/R be a smooth geometrically connected surface. Assume 
that X(R) is compact. Then the Bloch—Ogus spectral sequence ( * ) degenerates. 


Proof. Since the non-zero terms of the spectral sequence satisfy p < q and p < 2, 
the only differentials in the sequence which might be non-zero are the differentials 


d,: H°(X, #') > H2(X, #*-!) (i= 3). 


If X(R) = @, then H‘(R(X)) = 0 for i = 3, hence all differentials vanish. We 
may therefore assume X(R) + @. From the spectral sequence we get exact se- 
quences (i = 3): 

H'(X)> H°(X, #') > H?(X, #'*"!). 


Given any Zariski open set U c X, the functoriality of the spectral sequence gives 
rise to a commutative diagram of exact sequences 


H'(X) > H°(X, #') + H?(X, #'-') 
{ { { 
Hi(U) > H°(U, #') > H2(U, #*-!) . 


Let U c X be a Zariski open set such that U(R) = X(R). Since the cohomological 
dimension of C is zero, and the cohomological dimension of the function field of an 
integral curve C over R with C(R) = @ is at most one ([27] or Proposition 1.2.1), it 
follows that for i = 3, the Bloch—Ogus resolutions of the sheaves #' over X and 
over U coincide. Hence for any such U, the two right vertical arrows are isomor- 
phisms for i = 3, except possibly for the restriction map H?(X, #”) + H?(U, #7). 
This map may be identified with the restriction map CH?(X)/2 + CH?(U)/2, 
hence also with the restriction map CH )(X)/2—CH,(U)/2 (where CH,(U) 
denotes the Chow groups of 0-cycles modulo rational equivalence.) 

Let Z be a smooth compactification of X. Let F be the closed set Z\ X and let 
S be the set of connected components of Z(R) = X(R). We have the following 
commutative diagram: 


CH,(F)/2 > CH,(Z)/2 > CH,(X)/2 +0 


(Z/2)8 


The top exact sequence is the localisation sequence mod2. The vertical map 
is the isomorphism constructed in [7]. By construction, it maps complex closed 
points to zero. Since F(R) = @, it follows that CH,(Z)/2 + CH,(X)/2 is an iso- 
morphism. The same argument applies to CH,(Z)/2-—-CH,(U)/2. Thus the 
restriction map CH,(X)/2 > CH,(U)/2 is an isomorphism, hence also the map 
H?(X, #7) > H?(U, #7”). 

Thus, for i = 3, if for some open set U as above the map H'(U) > H°(U, #') is 
surjective, so is the map H‘(X) > H°(X, #'). 

To prove the proposition, it is enough to find such an open set U. As was shown 
in 2.4, there exists a finite set of functions f;¢ R(X), 1 <j < N which are invertible 
on X(R) and such that any element of the finite group H°(X, #') c H'(R(X)), 
i = 3,is a cup-product { f;, — 1,..., — 1} for some j. Let U c X bea Zariski open 
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set such that U(R) = X(R) and such that all the functions f; are invertible on U. 
The map H°(X,#')—H°(U, #') being an isomorphism, any element of 
H°(U, #') is represented by a cup-product {f;,—1,...,—1} for some j, 
1 <j < N, and such a cup-product clearly comes from H'(U). O 

We shall now use the vanishing of d, to give a sufficient condition for 
H°(X, #7) (which is none other than the 2-torsion subgroup of the Brauer group 
of X) to separate connected components of X(R) (cf. [6], 3.6). This condition is 
fulfilled by smooth surfaces in P? and more generally by complete intersections in 
projective spaces. 


Proposition 3.1.2. Let X /R be a smooth surface with X(R) compact. If H3(X¢, Z/2) 
is zero, then the mod 2 signature map 


h,: H°(X, #7) > (Z/2)8 
is surjective. 


Proof. There is an exact sequence of finite étale group schemes over R 


0+ (Z/2)n > (reyn)g((Z/2)c) "> (Z/2)n + 0 


which induces an exact cohomology sequence 
H?(X)> H3(X)> H3(X¢). 
It is well-known that the connecting homomorphism in this sequence is given by 
cup-product with {— 1}. Thus, in the following commutative diagram: 
4x) A. UK) + 0 
| | 
H(X, 7) 14, Hx, 93) 
ee hs | = 
(Z/2)° 
under the hypothesis of the proposition, the top map is surjective. The map 
H?(X)—+ H°(X, #°%) is surjective by (**) and the previous proposition. This 
implies the surjectivity of h,. O 
Remark 3.1.3. Let X/R be a smooth surface with X (R) compact. If X is affine, then 


H*(X,) is always zero (cf. [25] p. 51). On the other hand, if X/R is projective, by 
duality, H*(X,) = 0 if and only if ,Pic X, = 0. 


3.2. Upper bounds for the number of connected components 


Proposition 3.2.1. Let X /R be a smooth geometrically connected surface with X (R) 
compact. Let S be the set of connected components of X(R) and let s be the cardinality 
of S. Then: 


(i) There is a short exact sequence 


0 > H'(X, #7) > H3(X) > HX, #3) 0. 
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(ii) There is a natural injection CH?(X)/2 s H*(X). 
(iii) All the groups H'(X, #*) are finite. 
(iv) The following inequalities hold: 


2s S$ dimz,H'(X), i=4 
2s —1<dimz,,H3(X). 


Proof. (i) and (ii) follow immediately from the exact sequence ( ** ) and the vanish- 
ing of d,, and (iii) follows from the vanishing of all differentials and the finiteness of 
the groups H'(X). 

To prove (iv), we may and shall assume X(R) + @. 

By using the exact cohomology sequence on function fields deduced from ( +** ) 
and the vanishing of H‘(C(X)) for i> dim X, we conclude that the cup-product 
with {— 1} induces an isomorphism of the Bloch-Ogus resolutions of #' with that 
of #'*!, i > 3. Thus H?(X, #') ~ H?(X, #'*'), i= 3. 


We now show that H?(X, # a H?(X, #3) is also an isomorphism. Let 
U be an affine open subset of X such that U(R)= X(R). Then the map 
H?(X, #*) > H?(U, #7) is an isomorphism (cf. Proof of 3.1.1). We have the 
following commutative diagram: 


H?(X, #7) > H?(U,#?) g H*(U) 
v{-Hy v{-H v{-Hh 
H?(X,#°) — H*(U,#?*) g H*(U), 


where the right hand side vertical map is injective in view of ( *** ) and the fact that 


v{-} 


H*(U,) =0 ([25], p. 51). Hence the map H?(X, #*)——— H?(X, #°) is 
injective and a glance at the resolutions of #” and #° reveals that it is also 
surjective. (From these resolutions together with the exact cohomology sequences 
coming from ( *** ) one can also deduce injectivity, by using the fact that the norm 
map CH,(X,)/2 + CH,(X)/2 is zero — indeed CH)(X ,)/2 is spanned by the class 
of a real point P, and the norm of such a point is 2P). 

We have the following equality for i 2 3: 


dim 2, H?(X, #') = dimz,. H?(X, #7) = dimz,(CH?(X)/2)=s. 


Combining this with the fact that H°(X, #') — (Z/2)$, i = 3 (cf. Theorem 2.3.1) 
and the (non-canonical) decomposition 


H'(X)> H°(X, #')@H'(X, H'*"')@H*(X, H'*-?) 


arising from the vanishing of all differentials, the first equality of (iv) follows. In 
view of the decomposition 


H*(X) > H°(X, #°)@H'(X, #”), 
to establish the second inequality, it is enough to prove: 


dim 7,,H'(X, H*) = s—1. 
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As Bloch [2] has shown, there is an exact sequence: 
0—> H'(X, #,)/2 + H'(X, #,/2) > ,CH?(X)>0. 


On the other hand, Merkurev’s theorem [18] (see also [19]) implies that there is an 
isomorphism of Zariski sheaves %,/2 ~ #7. Thus there is an exact sequence 


0+ H1(X, #,)/2 + H'(X, #7) > ,CH?(X)>0. 


(Here and further below , A denotes the 2-torsion subgroup of an abelian group A.) 
Now CH?(X) = CH,(X). The second inequality will follow if we can prove: 


s—1<dimz,(,CH,(X)). 


We can clearly assume X(R) + @. If X is proper over R, this inequality is proved in 
[10], §1.3. Assume that X is not proper, and let Z be a smooth R-compactification 
of X (X is realized as an open set of Z). We have X(R) = Z(R). Let P be a closed 
point of Z not in X. The residue field x(P) at P is the complex field C. Let 
A,(Z) < CH,(Z) be the subgroup of CH,(Z) consisting of classes of 0-cycles of 
degree 0 and let A o(X) < CH,(X) be the subgroup of CH,(X ) consisting of classes 
of 0-cycles of even degree (over R). Since any closed point of Z\ X has degree 2, this 
latter subgroup is well defined. The restriction map A,(Z) > A,(X) is surjective. 

The surjective map [7] @:A,(Z)—(Z/2)*"' factorizes through the 
map A,(Z) > Ay(X ). Indeed, if a 0-cycle on Z is rationally equivalent to 0 on X, 
then it is rationally equivalent on Z to a 0-cycle which is a linear combination of 
closed points in Z\X, and such points have even degree over R. We thus get 


a surjective map W: A(X ) > (Z/2)'-!. The induced map Ker(g) > Ker (i) is 
surjective. Since Ker(¢) is divisible ({7]), it follows that Ker () is divisible. Thus 
the map 2Ag(X ) + (Z/2)%~* induced on 2-torsion is surjective. From the obvious 
inclusion ,A)(X) < ,CH,(X) the claimed inequality now follows. O 


Remark 3.2.2. The second inequality in (iv) together with the Hochschild—Serre 
spectral sequence yields the inequality 


2s < > dim znH*(G, H'(X,)) 
O<is4 


which also follows from Smith theory (cf. Krasnov [16]). Note however that for 
X/R proper, better bounds are sometimes given by the inequality 


4s-1<5 YO dimz,H(X,)+h'(X,) 


Osis4 


obtained by a combination of Smith theory and Hodge theory (Harlamov [13]). 
If H3(X,) = 0, Smith theory ([16]) gives an inequality 


2s + dim z,.H '(X(R), Z/2) < 2 + dimz,H'(G, H?(X,)) + dimz,H'(G, H'(X,)), 
whereas the proof of the second inequality in (iv) gives: 

2s + dimz,H'(X, #,)/2 <2 + dimz,H'(G, H?(X,)) + dimz,H'(G, H'(X,)). 
Thus any lower bound on dimz,,H '(X, # ,)/2 leads to a better upper bound for s. 
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The particular case of rational surfaces will be considered below. In more general 
cases, Proposition 4.9 of [9] might help. 


3.3. Rational surfaces 


Let X/R be a smooth projective geometrically connected rational surface, i.e. X, is 
C-birational to a projective plane. Then Pic X, is a finitely generated Z-free 
G-lattice (G = Gal(C/R) = {1, o}). As any such G-lattice, it may be written as 
a direct sum: 


Pic X¢ =~ Z*@(Z[G]/Z(1 + 0)" @® Z(G] (a,b,ceN), 


where Z[G] = Z @ Zo, the integers a, b, c being determined in a unique way by the 
G-lattice Pic X¢. 

Assume X(R) + @. In 1977, Sansuc and the first named author conjectured 
that b = 2s — 2, ie., 


H1\(G, Pic X,) = (Z/2)5~? . 


This was later proved by Silhol [26]. As pointed out to us by V.M. Harlamov, 
a more general result already follows from ([14], Lemma 3.7), together with the 
Lefschetz fixed point formula. See also Wall ([27], p. 57). 

The following proof should therefore just be viewed as an illustration of the 
methods of the present paper. 

By the main theorem, H°(X, #°%) =~ (Z/2)’. Since X¢ is a rational surface, 


Ao(X¢) = Oand we have ([7]) Ao(X) = (Z/2)*"*, hence ,CHo(X) = (Z/2)*"*. On 
the other hand, there is a natural isomorphism ([6]): 


H'(X, #,) ~ Hom,(Pic X¢, C*), 
which induces an isomorphism 
H'(X, #,)/2 ~(Z/2y . 
Finally, using the isomorphism 


H3(X)—>H°(X, #3) @ H'(X, %)/2® ,CH,(X), 


we get 
H3(X) = (Z/26*78-1 

Since X is a rational surface, H'(X,) =~ ,Pic X, = 0. By Poincaré duality, we also 
have H*(X-)=0. Since moreover X(R)+@, in the spectral sequence 
HG, H4(X¢, Z/2))=>H"(X) the map E}° > H"(X) is injective. Thus there is 
a (non-canonical) isomorphism 

H*(X) =~ H°(G, Z/2)® H'(G, H?(Xc)). 
The rationality of X¢ implies that the (2-torsion of the) Brauer group of X¢ is 
trivial. An application of the Kummer sequence gives 


H?(X¢) = Pic X_/2 =~ F3*°@F, [GT , 
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so that 


H3(X) ~ Be gigi : 


A comparison of the two values of H*(X) gives 


b=2s—2. O 
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On Calabi’s conjecture for complex surfaces with 
positive first Chern class 


G. Tian 
School of Mathematics, Institute for Advanced Study, Princeton, NJ 08540, USA 


It is known by _ classification theory of complex surfaces that 
CP? #nCP?(0 <n < 8)and CP’ x CP’ are only compact differential 4-manifolds 
on which there is a complex structure with positive first Chern class. In [TY], the 
authors proved that for any n between 3 and 8, there is a compact complex surface 
M diffeomorphic to CP? #nCP? such that C,(M) > 0 and M admits a Kahler- 
Einstein metric. This paper is the continuation of my joint work with professor 
S.T. Yau [TY]. The main result of this paper is the following. 


Main theorem. Any compact complex surface M with C,(M)>0 admits 
a Kahler-Einstein metric if Lie (Aut(M)) is reductive. 


This theorem solves one of Calabi’s conjectures in case of complex surfaces. The 
conjecture says that there is a Kahler-Einstein metric on any compact Kahler 
manifold with positive first Chern class and without holomorphic vector field. Our 
proof of the above theorem is based on a partial C°-estimate of the solutions of 
some complex Monge-Ampére equations we will develop in this paper (Theorem 
2.2, Theorem 5.1) and the previous work of the author in [T1] and the joint work 
with S.T. Yau in [TY]. 

Let M be a compact Kahler manifold with positive first Chern class and g be 
a Kahler metric with its associated Kahler class w, in C,(M). Then, the existence of 
a Kahler-Einstein metric on M is equivalent to the solvability of the following 
complex Monge-Ampére equations 


(o, + v “<0 ) = ef uf 


2n 


(0, + . —*aép ) >0 


(0.1), 


2n 


where n = dim. M, pe C®(M, R'),0 St < 1 and fis a smooth function determined 
by equations 


Ric(g) — w, = vo and { efw" = { w? = C,(M)" 


Ue M M 
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Since Yau’s solution of Calabi’s conjecture for Kahler manifolds with vanishing 
first Chern class, it has been known that the solvability of (0.1), for 0 < t < 1 would 
follow from an a prior C°-estimate of the solutions of (0.1),. The difficulty is that 
such a C°-estimate does not exist in general due to those obstructions found by 
Matsushima [Ma], Futaki [Fu]. In [T1], the author reduces such a C°-estimate to 
some integral bound on the solutions of (0.1),. There are two ways of obtaining 
such an integral bound on the solutions. One of them is to evaluate the optimal 
constant of some linearized versions of Moser-Trudinger inequalities for almost 
plurisubharmonic functions on M as the author did in [T1]. Another is to obtain 
more informations about the solutions of (0.1), and relate the above integral bound 
of the solutions to the geometry on M, specially, the geometry of plurianticanonical 
divisors in M. This second approach is our major motivation in this paper to 
develop an a prior partial C°-estimate for the solutions of (0.1), in case of complex 
surfaces. 

Our partial C°-estimate for (0.1), is based on the following observation. The 
solvability of (0.1), for 0 <t < 1 does not depend on the choice of a particular 
Kahler metric g, that is, there is some “gauge” group of the complex Monge- 
Ampére equations (0.1),. The author’s belief is that such a “gauge” group should 
play a role in obtaining the C°-estimate for the solutions of (0.1),. To understand 
this “gauge” group, we first recall some natural classes of Kahler metric with its 
Kahler form in C,(M). Note that the anticanonical line bundle Ky’ is ample. 
Therefore, by Kodaira’s embedding theorem, for m sufficiently large, the plurian- 
ticanonical line bundle Ky’ is very ample, that is, any basis of the group 
H°(M, Ky”) gives an embedding of M into some projective space CP’™, where 
N,, + 1 = dim, H®(M, Ky”). Then we have a collection C,, of Kahler metrics 


consisting of the restrictions of the —-multiple of Fubini-Study metric on CP’ to 
m 


the embeddings of M induced by the bases of H°(M, Ky”). These Kahler metrics 
are parametrized by the group PGL(N,, + 1). Thus one can consider PGL(N,, + 1) 
for m large as a “gauge” group of (0.1),. Now let us see how this group plays a role in 
our partial C°-estimate for solutions of (0.1),. The differences of the metrics in @,, 
from the fixed Kahler one 4 provide a natural set @;,, of smooth functions yw in 


C*(M, R') with w, + ~ os l aay >0on M and y* 0. One can regard the 


functions in C;, as the generalized polynomials on M of degree m. For instance, if 
M = CP", then the sections in H°(M, Ky”) correspond one-to-one to the homo- 
geneous polynomials of degree m and any function in @,, is determined by a basis of 
the linear space of all homogeneous m-polynomials. We now propose the following 
estimate for the solution of (0.1),: there is a m > 0, depending only on the geometry 
of M, such that for any solution ¢ of (0.1),, there is a function y in @,, satisfying 


lle — sup g — Wilcom) SC (0.2) 
M 


where C is a constant independent of g, t. In particular, (0.2) implies that for any 
solution ¢ of (0.1),, there is a subvariety V, < M away from which @ — supy g is 
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uniformly bounded and the degree V, with respect to Ky’ is bounded independent 
of g. Therefore, we can call (0.2) a partial C°-estimate for (0.1),. 
We further observe (cf. Lemma 2.2) that (0.2) is equivalent to the following 


Nm 
oe( sv ia) eC (0.3) 
0 


v= 


where C’ is a constant depending only on the geometry of M, the metric g, is given 


onl 
2n 


by its Kahler form w, + 


@, + Vado as its curvature form and {S"}o<,<wy, is an orthonormal basis 
with respect to the inner product induced by g, and || - ||,,. To prove (0.3), it suffices 
to construct plurianticanonical sections on M with its norm bounded from below 
at any assigned point. In this paper, it is done for t = 1 and complex surfaces, i.e., 
n = 2, by using L?-estimate for d-operators, Gromov’s compactness theorem and 
Uhlenbeck’s theory for Yang-Mills connections (cf. Theorem 2.2, 5.1). Moreover, 
we can take m in either (0.2) or (0.3) to be less than 7 for t = 1 and on compact 
complex surfaces with positive first Chern class. In general, we believe that the 
estimate (0.3) is also true on higher dimensional Kahler manifolds with positive 
first Chern class. Note that the group PGL(N,, + 1) contains the automorphism 
group Aut(M) of M. The obstructions of Matsushima and Futaki are from this 
latter group. 

Next, we assume that M is always a complex surface with positive first Chern 
class. In order to prove the existence of Kahler-Einstein metric on M, we need to 
evaluate the supremum «,,(M) of those exponents « such that the function 
exp( — a) for w in @,, are uniformly L'-bounded, where m < 6 appears in the 
partial C°-estimate (0.2). If such an «,,(M) is strictly larger than 2/3, then by [T1] 
and the partial C°-estimate (0.2) for solutions of (0.1),, there is a Kahler-Einstein 
metric on M. But sometimes the number «,,(M) could be exactly 2/3, then we need 
to further study the generalized polynomial functions yp in the partial C°-estimate 
(0.2) for the solutions of (0.1), and improve the main theorem in [T1] (cf. section 
2 for details). All these lead to the proof of our main theorem stated above. 

The organization of this paper is as follows. In section 1, we give some prelimi- 
nary discussions and reduce the proof of our main theorem to some a prior 
C°-estimate for the solutions of complex Monge-Ampére equations. The argu- 
ments here are standard. In section 2, we prove our main theorem under the 
assumption of Theorem 2.2 (strong partial C°-estimate). Some interesting improve- 
ments of the main result in [T1] are given. In sections 3 and 4, we begin our first 
step of the proof of the strong C°-estimate, i.e., Theorem 2.2. Gromov’s compact- 
ness theorem and Uhlenbeck’s theory for Yang-Mills connections are applied for 
this purpose. In section 5, we use Hémmander’s L?-estimate for d-operators on 
plurianticanonical line bundles to prove a weaker version of Theorem 2.2, iLe., 
partial C°-estimate stated in either (0.2) or (0.3). We also apply L?-estimate for 
d-operators to making reductions of the singular points of some 2-dimensional 
K 4hler-Einstein orbifolds. In particular, we prove that if a Kahler-Einstein orbifold 


000, |\* \lg. is the hermitian metric of Kj” with 
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is the limit of some sequence of Kahler-Einstein surfaces with positive scalar 
curvature, then it has at most some Hirzebruch-Jung singularities of special type 
besides rational double points (Theorem 5,2). In sections 6, 7, by studying the 
plurianticanonical divisors of some rational surfaces, we complete the proof of 
Theorem 2.2 (strong partial C°-estimate). There are two appendices, in which we 
prove one lemma (Lemma 2.4) and one proposition (Proposition 2.1) stated in 
section 2. The lemma concerns the singularities of plurianticanonical divisors on 
a complex surface with positive first Chern class and diffeomorphic to either 
CP? # 5CP? or CP? # 6CP?. The proposition should be a classical and elementary 
result. In the course of the proof of our main theorem, we also obtain some results 
on the degeneration of Kahler-Einstein surfaces (Theorem 7.1). We refer readers to 
the end of section 7 for details. 


I would like to specially thank Professor S.T. Yau for his continuous encouragement and 
stimulating conversations during the course of this work. Actually, he brought Gromov’s 
compactness theorem and Uhlenbeck’s theory to my attention more than two years ago. I would 
also like to thank Professor R. Schoen from whom the author learned his solution of Yamabi 
problem in U.C.S.D. His work on Yamabi problem has indefinite influence in my program for the 
proof of the main theorem here. I would also be grateful to Professor K.C. Chang and Professor 
W. Ding for some stimulating conversations. Finally, I would also like to thank Harvard 
University and Institute for Advanced Study for their generous financial support during the 
course of this work. 


1. Preliminaries 


Let M be a complex surface with positive first Chern class C,(M). It is known 
(cf. [GH]) that M is of form either CP! x CP' or CP? #nCP? (0 < n KS 8), i.e., the 
surface obtained by blowing up CP? at n generic points, where “generic” means 
that no three of these points are colinear and no six of them are on the same 
quadratic curve. As symmetric spaces, CP' x CP' and CP? admit the standard 
invariant metrics. These invariant metrics are Kahler-Einstein metrics. An easy 
computation shows that for n = 1 or 2, CP? #nCP? has non-trivial holomorphic 
vector fields and the Lie algebra of these holomorphic vector fields is not reductive. 
Thus Matsushima’s theorem [Ma] excludes the existence of Kahler-Einstein 
metrics on these CP? # nCP? (n = 1, 2). The following theorem is proved in [TY] 
by estimating the lower bound of the holomorphic invariant introduced in [T1]. 


Theorem 1.1. For each integer n between 3 and 8, there is a complex surface M of 
form CP? #nCP? such that M admits a Kahler-Einstein metric with positive scalar 
curvature. 


Remark. By a completely different method, Professor Siu [Si] also proved the 


existence of Kahler-Einstein metrics on CP? # 3CP? and Fermat surface in CP?. 
His proof requires that the manifolds considered must have many symmetries, 
while ours does not. 


Denote by 3, the collection of all complex surfaces of form CP? # nCP? with 
positive first Chern class, in other words, those complex structures on the under- 
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lying differential manifold CP? #nCP? such that the first Chern class is positive. 
One can easily prove that for n = 3 or 4, §,, consists of only one element, i.e. the one 
on which there is a Kahler-Einstein metric constructed in Theorem 1.1. Hence, in 
order to prove our main theorem, we may assume that 5 <n < 8. 


Lemma 1.1. 3, is connected in the sense that for any M, M' in $,, there is a family of 
{M, }o<ns1 Such that M, = M, M, = M’, M,€3,, and M, depends smoothly on t. 


Proof. By induction, we may assume that M, M’ are the surfaces obtained by 
blowing up CP? at generic points p,,..., P,; Pi, - +» Pa» Fespectively and p; = p; 
fori = 12 n= 1. Let D be the union of lines p;p; in CP? for 1 < i,j <n—1and 
the quadratic curves in CP? passing through five of p,,..., Pn—-1- CP?\D is 
connected. Now it is easy to see how to connect M to M’ smoothly in §,. 


Lemma 1.2. For n 2 5, each M in 3, has no non-trivial holomorphic vector field. 


Proof. It suffices to prove that the identity component Aut,(M) of the auto- 
morphism group is discrete. It is clear that 


Aut,(M) = {oe Aut(CP?)|o interchanges p,,..., P,} 


where p,,..., p, are the blowing-up points of M in CP?. Then the lemma follows 
from a straightforward calculation. 

We fix a n between 5 and 8 and let M, be the complex surface with 
K4ahler-Einstein metric g, in Theorem 1.1. Then M, is in %,,. In order to prove our 
main theorem, we pick an arbitrary smooth family {M,}o<,<, from 9,,. It suffices to 
prove that any M, admits a Kahler-Einstein metric with positive scalar curvature. 
We will use the continuous method. Let 


I = {te[0,t]|M; admits Kahler-Einstein metric for t' < t} . 


Then J contains 0, in particular, J is nonempty. We need to prove that J is both 
open and closed. In this section, we will prove that J is open. The next several 
sections are devoted to the proof of the closedness. As in [Y1], [T1], etc., we first 
convert the existence of Kahler-Einstein metrics into solvability of some complex 
Monge-Amperé equation. Since the entire family {M,} is in §,,, there is a smooth 
family of Kahler metrics g, on M, with0 <t < 1. Let w; be the associated Kahler 
form of g,, then in local coordinates (z,,z,) of M,, 

fats a 2 dais 

,, = Gupdz, Adz; where g,= } Gudz,;@dz, 

2m ij=1 i,j= 
We choose g, such that its Kahler form @, represents the first Chern class of M,. 
Then by solving a family of elliptic equations, we can have a smooth family of 
functions { f;}o<;<, such that 


ie, 
Ric(G,) = @;,, +*.—0f,, f§ eftdV, =9-n 
we Qn Mi e 


where dV; = wj = w;, A @;, is the associated volume form of g, and Ric(g,) is the 
Ricci form, i.e., in local coordinates (z, , 22), if we denote by (R,;;) the Ricci curvature 
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tensor, then 


Ric(g,) aay 


Ri dz; A dz; 


\- ee oe 


It is well-known that the existence of Kahler-Einstein metrics on M, is equi- 
valent to the solvability of the following complex Monge-Amperé equation on M, 


(cf. [Y1]). 
cele. Ne 
(o, +> cao ) = eft" %q? 


(o,,+ ns “dG ) > 0 


Tl 


We remark that if (1.1), has a solution ¢,, then the corresponding K4hler-Einstein 
/-1 
2n 


We first prove the openness of J by applying Implicit Function Theorem to the 
equation (1.1),. 


metric has @; + 00, as its Kahler form. 


Lemma 1.3. Let {M,}, I be defined as above. Then I is open. 


Proof. Let (1.1),, has a solution g,,. The linearized operator of (1.1), at t = to is 
L,, = 4,, — id, i.¢., for any smooth function v, L,v = 4,,v — v, where 4,, is the 
Laplacian associated to the Kahler-Einstein metric g, on M,,.. 

By Lemma 1.2 and the standard Bochner’s formula, one can prove that the first 
nonzero eigenvalue of 4,, is strictly greater than one (cf. [Au]). It follows that the 
linearized operator L,, is invertible. Then this lemma follows from Implicit Func- 
tion Theorem. 

Therefore, it suffices to prove that J is closed in the interval [0, 1]. Without 
losing the generality, we may assume that [0, 1)e/. By the standard elliptic theory, 
to show that 1 €/, it suffices to prove the uniform C?-estimate of the solutions of the 
equations (1.1),. 


Lemma 1.4. There is a constant C independent of t such that for any solution ~ of 
some equation (1.1),, we have 


sup {Valls IV lla, Ve glig,0)} S Csup {lo(x)|} 


zeM; zeM; 


where V, is the gradient with respect to the metric g , and |-|; is the norm induced by 

G- 

Proof. It follows from same computations as the corresponding ones in [Y1]. 
By this lemma, we only need to prove the uniform C°-estimate of the solutions 

of equations (1.1),. This will be done in the following sections. We should mention 

that obtaining such an a prior C°-estimate is the hardest part of solving this 

conjecture of E. Calabi. 
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2. The proof of main theorem 


In this section, we will prove our main theorem under the assumption of Theorem 
2.2. We postpone the proof of this theorem to the next several sections due to its 
length. Basically, this theorem provides us a strong partial C°-estimate of the 
solutions of the complex Monge-Amperé equations (1.1),. Let {M,}o<,<, be the 
smooth family in 3, given in last section, where 5 < n < 8. Then each M, for t < 1 
has a Kahler-Einstein metric g, with Ric(g,) = @,. It follows that each equation 
(1.1), for t < 1 has a solution g,. Note that such a solution ¢, is unique by Bando 
and Mabuchi’s uniqueness theorem [BM]. By the discussions in last section, in 
order to prove the main theorem, it suffices to show the uniform C°-estimate of 
those solutions @,. 

In [T1], the author reduces the C°-estimate of the solution ¢, to the evaluation 
of some integral of g,. By evaluating this integral, the author proves in [T1] the 
existence of Kahler-Einstein metrics on Fermat hypersurfaces in CP"*' of degree 
n or n+ 1 and the authors in [TY] prove Theorem 1.1. Here we develop an 
effective method to evaluate the integral posed in [T1] for the C°-estimate of 9,. 
We start with the following theorem, which is essentially the main theorem proved 
in [T1]. 


Theorem 2.1. Let {M,} be the family in §,, given as above. Then the Kahler manifold 
M = M, admits a Kahler-Einstein metric with positive scalar curvature if and only if 
one of the following holds. 


(1) There are constants ¢, C > 0 and a subsequence {t;}; >, in the interval [0, 1) with 
lim; . t; = 1, such that for all i and any solution @,, of (1.1),,, 


f e ~ 2/3 + Ko, — 7 ava, <C (2.1) 
M,, 


(2) There are constants ¢,C > 0 and a subsequence {t;}; >, in the interval [0, 1) with 
lim; .. t; = 1, such that for all i and any solution ¢,, of (1.1),,, 


— infg,, S (2 — e)sup@,, + C (2.2) 


M;, M i 


and moreover for any 1 < 4, there is a constant C(A), depending only on A, such 
that 
f e~ A weeay, SCO) (2.3) 


M;, 
Proof. Consider complex Monge-Amperé equations 


| RT Ear 
(o,.+ 200 | = eft eye 


2n 


2n 


where s < 1. By Lemma 1.2 and uniqueness theorem in [BM], the solution of 


(2.4),,s 
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equation (1.1), for each t is unique. Thus by the same argument as in [BM] for the 
proof of the uniqueness, one can produce a family {9,,,}o<:,;<; Of smooth func- 
tions, such that the function , , solves the equation (2.4), , and lim, ; @,; = 9. 
Thus in case (1), the theorem follows from the proof of the main theorem in [T1]. 


2- 2 : ; 
In the case (2), choose 1 between 3 : and 3 then as in [T1], by the concavity 
of the logarithm function, we have 


1—-A 
sup 9, < —— J (- ,)a%,, + C'A) (2.5) 
M,, A M,, 


where C’(A) is a constant depending only on 4. Combining this with (2.2), we obtain 
the uniform C°-estimate of the solution ¢,,. The theorem follows. We refer readers 
to [T1] for more details. 

By this theorem, we see that, to prove the main theorem, it suffices to find 
a subsequence {t;} having the estimates either (2.1) or (2.2), (2.3). 

For t<1, we choose an orthonormal basis {Sigho<g<n, Of the group 
H°(M,, K'z,) with respect to the metric g,, when m = 1 and N,, + 1 is the dimension 
of H°(M,, K’%y,). By Kodaira’s embedding theorem, those bases {Ship }o < p< n, define 
embeddings ®(t, m) from M, into CP%™ for m large. In fact, when n = 5, 6, the 
embeddings #(t, 1) are well-defined. 


Theorem 2.2. (Strong partial C°-estimate). There are constants c(n, m) > 0, depend- 
ing only on n, m, and a subsequence {t;} in the interval [0, 1) with lim;. ,, t; = 1, such 
that for m = 6k (k = 1) in case n = 5, 6, and m = 2k (k = 1) in case n = 7, 8, 


inf 2 z [Stig 2, 0) > c(n, m) (2.6) 


xeM,, 


where ||° ||g, is the norm on the line bundle Ky” induced by the metric g,. 


Remark. In case n = 5, 6, 7, the estimate (2.6) should also hold for m = 1. This can 
be used to simplify the proof of our main theorem, but the simplification is not 
substantial. 

The proof of Theorem 2.2 will be given in the following sections. We will first 
prove a weak version of this theorem, i.e., Theorem 5.1, in §5. Then we deduce 
Theorem 2.2 from that weak version. 

Let us now see the implications of Theorem 2.2. For each te [0, 1), we further 
choose an orthonormal basis {S mpsospsn, Of H°(M,, Ky”) with respect to the 
metric g,. Such a basis gives an embedding Y(t, m) of M, into CP’™ whenever the 
basis {Sj,,} does. Two embeddings ¥(t,m), ®(t,m) are different by an auto- 
morphism a(t, m) in CP’, i.e. a(t, m)e PGL(N,, +1) and 


P(t, m) = a(t, m) P(t, m) (2.7) 


By changing the orthonormal bases {Stipto<p<v.> {Shptospen, if necessary, we 
may assume that each a(t, m) is represented by a diagonal matrix diag(/,(t))o <j <n, 
withO<A,(t)S... SAy (= 1. 

The following lemma is actually an observation on which the whole proof is 
based. 
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Lemma 2.1. Let M,, 9, {Shp}o< pv.» {Sinp}osp<n, be given as above, where t < 1. 
Then for m = 6k(k 2 1) in case n = 5, 6 or m = 2k (k 2 1) in case n = 7, 8, 


N, 


1 1 Na Pe 
% =f - iog( Y WS i2) . “og( Y gl? Sine 3 +a(t) (2.8) 
m m pro 


B=0 
where a(t) is a constant depending only on t. 


Proof. We remark that under the assumption on m, the group H°(M,, Ky”) is free 
of base point. Thus the left-handed side of (2.8) is a well-defined function on M,. We 
denote it by g;. One can check that q; satisfies the equation 


Y —f ado! 


Wy, = W;, + In 


On the other hand, the solution 9, of (1.1), also satisfies the same equation. The 
lemma follows. 

From now on, in this section, we fix the subsequence {t;} in Theorem 2.2. For 
simplicity, in the following, we will replace t; by i whenever t; appear as subscripts 
or superscripts. The following lemma is a corollary of Theorem 2.2 and also 
explains why we call (2.6) in Theorem 2.2 “partial C°-estimate”. 


Lemma 2.2. Let {(M;, g;)} be the subsequence of Kahler-Einstein manifolds given in 
Theorem 2.2. Define v = 6 in case n = 5, 6 and v = 2 in case n = 7, 8. Then there is 
a constant C independent of i, such that for any solution 9; of (1.1),,, 


1 eee 
sup |p; — sup y; — vloe( d sl? IS np 3) sc (2.9) 
5 M; v p=0 


where {Ap(i}o< g<n, are defined by those automorphisms o(t;, v) in (2.7). 


Proof. Note that both metrics g; (resp. functions f;) converge to a smooth metric 
gj (resp. a smooth function f) equal to g,(resp. f,) with t = 1. Then the lemma follows 
from Lemma 2.1 and Theorem 2.2. 


Remark. This lemma implies that the normalizations g; — supy, ; are uniformly 
bounded away from some subvarieties in M;. One should be able to derive from it 
that g; — supy, 9; either are uniformly bounded or converge to a function G on 
M\D, where M = lim M; and D is a subvariety of M contained in anticanonical 


Tt 
has logarithmic singularity along D. This singular function G can be regarded as 
a Green function of the complex Monge-Amperé operator. This Green function 
must impose some analytic structures on M. Hopefully, by studying these struc- 
tures, one can determine when 9; converge to a bounded function on M. 

Let v be defined as in the above lemma. We define rational integrals I(«, i) as 
follows, 


lhe ¥ ; 
divisors, such that G satisfies the equation (~, a eor de <) = 0 outside D and 


N, ~ —alv 
I(a, i) = f ( dX pli? Sve i3) dV;,(z) (2.10) 


Mi p=0 
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Then by Lemma 2.2, we see that the estimates (2.1) and (2.3) are equivalent to 
I(a, i) < C for a = 2/3 + ¢ and 4, respectively. Thus we are bound to estimate the 
integrals in (2.10). This will be done in the following lemmas. 

Let {Sg}o<p<n, be the limit of the bases {Sip }y << y, aS i goes to infinity. Then 
this limit is an orthonormal basis of H°(M, Ky”) with respect to the metric g, 
where M = IM, for t = 1. By taking the subsequence if necessary, we may assume 
that lim;  , Ag(i) = 4, 2 0 for each B. Note that An, =landéA,<...8 Ay, 


Lemma 2.3. We adopt the notations given above. Let N = N,. Then we have the 
following estimates, 


(i) if n = 8, then I(a, i) < C, for any « <2. 
(ii) ifn = 7, then I(a, i) < C, for any « < 3. 


Proof. Since the proof for (ii) is identical to that for (i), we only prove (i) here. Put 
1 d a 
vi= “tog( DY lpi? Siro | i) 
v pao 


Denote by @; the Kahler form associated to the metric g,. Then @; + @0y; define 
positive, d-closed, (1.1)-currents w; on M;. When i tends to infinity, we may assume 


| se ee i 
that w; converge weakly to a positive, d-closed, (1.1)-current a 20 log(|S y\7) 
y 


denoted by w’,, where |-| is the absolute value. Now I[(a, i) is just the integral 
Ju,e” 'dV,.. By the discussion in §2 of [TY], we have 


Fact (+). If z;¢ M; with lim;.{ ,,.z; = z¢M and the Lelong number L;(w’,, z) < 1, 
then there is a r > 0 independent of i, such that 


f e™dv, <C, forany «<1 (2.11) 


B,(z;,9;) 


where B,(z;, g;) is the geodesic ball in M; with radius r and the center at z,;. For 
more about the Lelong number, one can refer to [Le]. 

Let D be the zero divisor of Sy. If zis either in the complement of D or a point of 
D with multiplicity 2, the Lelong number L;(@,,, z) < 1. Therefore, we only need to 
estimate the integral in (2.11) near those points z;¢ M; with lim;. ,. z; = z being 
a singular point of D with multiplicity = 3. 

Since C,(M)? = 1, D has no singular point with the multiplicity greater than 2 if 
it is irreducible. It implies that the Lelong number L;(@,,, z) < 1 at every point z in 
M if D is irreducible. So we may write Sy = SS. Since C,(M)? = 1, one can 
easily derive (2.11) by Fact (+) so long as S; is not colinear to S,. So we may assume 
that S; = S; and both S;, S; are in H°(M, Ky'). Also by Fact(t), it suffices to 
estimate the integral in (2.11) at the singular points of the divisor 
{xe M|S‘(x) = 0}. Let 2;:M;++> CP?, 1:M++>CP? be the natural projections in- 
duced by blowing-ups. Then each 7;,(S4) is a sextic curve in CP?, converging to 
n,(S y) = ,(S1)? as i goes to infinity. Now 7, (S‘) is an irreducible singular cubic 
curve in CP”. Each z, (S;) has only one singular point x, which is either an ordinary 
double point or a cusp, and is not one of blowing-up points. Without losing 
generality, we may assume that x is a cusp. Let U be a small neighborhood of x in 
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CP?, determined later. Then 


J e “dV, < c(1 + [ar] (2.12) 
where f; is the local holomorphic function defining Tin (S \) in U, dV is the volume 
form of the euclidean metric on U and C is a constant depending only on U. We 
will always use C to denote a constant independent of i in this proof, although the 
quantity of this could be changed in different places. We normalize those f; such 
that the limit f = lim; . ,.f, exists and defines n,(S y) in U. Choose local coordinates 
(z, w) with x = (0, 0) and 


f=(?-w*? (2.13) 


where f is the local defining function of the divisor D in U. By holomorphic 
transformations of form (z, w)++(z + b, + b,w + b,w?, w), we may assume that 


Si =f+ > y,(i)z* w' + Y ay,(i)z* w' 
3k + 21 < 12 3k + 212 12 
k+3 
=f+ fir + Sir (2.14) 


where lim; o dit = 0, lim; oo Sir = 0. Define 


1 
6;=40 max {|a,,(i)|?2-3*-27} (2.15) 
3k + 21 < 12 
We denote by J; the integral on the right side of (2.12) and split J; into three parts 
Ji, Ji2, Jiz as follows, 


dv 


wit swe Fil? 
12 |w| 233 
md |wi8dV 

jwi <1 Lfi(w? é w?)|?# 

st 
— |w[S-122dw a dw a dé a dé 
jw <1 \(é? a2 1) + w  °(fir(wré, w?) + fir(w?é, w?)|?7 

st 

By the definition of fi,, fig and 6;, for i sufficiently large, one can easily see 


[w~°( firtw°t, w?) + fin(w°e, w?))| S42 for 5;<|wisl, |g) <1 (2.17) 


It follows that for any fixed w with |w|<6,, the holomorphic functions 
(7 — 1)+w (fic + fiz) have exactly four distinct zeroes in {|€| < 1} for all i, 
moreover, these four zeroes are disjoint from each other by a uniform distance. 
ve we conclude that the integral J;, is uniformly bounded independent of 
i for a <2, ie., Jj; < C,. Similarly, we also have 


dV 
J; = a 
: a ue 


12|2 265 


Jin = 





<C, for any « <2 (2.18) 
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It remains to estimate J;3, which is equal to J; — Jj; —Jj2. By scaling 
(z, w) + (67z, 6? w), we have 
§10-12egp 
- ss |; *?f,(6? z, 67 w)|?* 


Iw st 





Ji3 


Put g; = 6; ‘7f,(6?z, 67w), then by taking a subsequence, we may assume that g; 
converge to a polynomial g. Note that by the expansion of f; in (2.14), we have 


g=(22-w)y+ Yo dyz*w' (2.19) 
3k + 21 < 12 
k<3 
where b,; are constants and at least one of them is nonzero. This new polynomial 
g is less singular than the function f, For example, one can compute 
dV 


11 
—-<+0 foranya<— (2.20) 
an Ig|? 24 


Iw S1 


dV 10 5 
5 get for any a2 = 15 (2.21) 


Iw| $1 
Also, the multiplicity of g at any point in {|z| < 1, |w| < 1} is less than that of fat the 
origin. Therefore, by induction we can prove that Jj, < C, for « <2. Case (i) is 
proved. The same arguments can be identically applied to case (ii). Then the lemma 
is proved. 
As a consequence of above lemma and Theorem 2.1, we have 


Corollary 2.1. If n = 7 or 8, then M admits a KaGhler-Einstein metric with positive 
scalar curvature. 


In order to complete the proof of main theorem, it remains to consider the case 
that n = 5 or 6. In fact, by the same arguments in the proof of Lemma 2.3, one can 
have analogous estimates of the integrals I («, i) in (2.10) (cf. Lemma 2.5 in the proof 
in the following). Of course, the involved computations are more complicated. 
Instead, we give an alternative discussion here. 


Proposition 2.1. Let { f,} be a sequence of holomorphic functions on the unit ball 
B, = {zeC?||z| < 1} such that lim;..,. =f, f + 0. Let B > 0 be such that the integral 
fiisilfl?*aV is finite, then for any « < B, we have 


fj dV lin f dV 

fe 2a 
sy iso i s4 Il 
where dV is the standard volume form on C?. 


(2.22) 


Remark. In fact, Lemma 2.3 is a corollary of Proposition 2.1 and some properties 
of plurianticanonical divisors. We gave a separated proof because it is much 
simpler and transparent. The above proposition should be a classical result. But 
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since I could not find its proof in literature to my limited knowledge, I include 
a sketched proof in Appendix 2. Actually, the proof is based on the modification of 
the above arguments in that of Lemma 2.3. The key point is how to make induction 
in general as we did before. The induction, as well as the proof for the following 
lemma, is completed by means of Newton polyhedrons associated to holomorphic 
functions (see Appendix 1 for details). 


Lemma 2.4. Let n = 5 or 6 and S be a global section in H°(M, Ky;°). Then there is an 
& > 0, such that (i) if n = 6, we have 


2+e 
f S| dV, < (2.23) 
M 


unless the reduced divisor {S = 0},¢4 is an anticanonical divisor and the union of three 
lines on M intersecting at a common point, where by a line on M, we mean an 
irreducible curve of degree 1 with respect to the anticanonical line bundle Ky’. (ii) if 
n = 5, we also have (2.23) unless either {S = 0} contains a curve with multiplicity 9 or 
{S = 0},eq is an anticanonical divisor and the union of two lines and a curve of degree 
2 intersecting transversally at a common point. 


In order to avoid distracting the readers from the main stream in the proof of 
our main theorem, we postpone the proof of this lemma in Appendix 1. 


Lemma 2.5. Let n = 5 or 6 and I (a, i) be defined as in (2.10). Then there are constants 
& > 0 and C, > 0 depending on «, where 0 < « < 4, such that (i) For « < 4, we have 
I(a,i) SC, (2.24) 


(ii) For « = 4, we have 
(ai) S$ Cy:Av- 173 (2.25) 
where N = Ng as in Lemma 2.2. Note that ¢, C, are independent of i. 


Proof. Choose ¢ > 0 such that 4¢ is given in Lemma 2.4. First we assume that 
n = 6. As before, put D = {S, = 0}. If D,.4 is not an anticanonical divisor consist- 
ing of three lines intersecting at a common point, then by Lemma 2.4(i), for 
as<#+e 

-2a 


f ISyll"® dV; < (2.26) 
M 


By Proposition 2.1, we have fora <$+e 


yey ~2e 
lim I(a, i) < lim f ISwwll © aV;5, 


ima io Mi 


-2a 


= f ISyl* dV, < 2 (2.27) 
M 


Hence, there are constants C, depending on a such that I(«, i) < C, for all i and 
a < $+. Thus we may assume that S$, = (S)°, where S$ is an anticanonical section 
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which zero divisor is the union of three lines intersecting at a common point. One 
can easily check that for « < 4, 


—2a 


f ISyI"@ dV, < 0 (2.28) 
M 


Then (1) follows from (2.28) and Proposition 2.1 as above. 
Let p be the intersection point of the three lines in {S = 0}, then for any open 
neighborhood U of p and0 <a<#+¢6, 


i -2a 
f ISyIF dV, < (2.29) 
M\U 
It is true simply because {S$ = 0} is smooth outside p. On the other hand, by the 
fact that no four lines of M intersect at a common point and a. + 2 linearly 
independent of Sy, one can easily show that if the neighborhood U of p is 
sufficiently small, then for « < 4 + ¢, 


-—2a 


§ Sys < (2.30) 
U 
Now applying Proposition 2.1, we have for a <4 +6, 
1 


lim (A¥2 ,1(a, i) < lim J 7 dV, 
tin io Mi(|Siy_4 |? + Sill?) 





< lim ({ \Siy a> > dV, + ISiut™ a, 


i+w MAU; 


=f Sw- Re i “AV, + 4. Syl Fay, < 0 (2.31) 


where U; are open sets of M; and converge to U as i oo. Thus (i) is proved. 

Next we assume that n = 5. If neither D contains a curve with multiplicity 9 nor 
D,.-4 iS an anticanonical divisor consisting of two lines and a curve of degree 
2 intersecting at a common point, then both (i) and (ii) follows from Proposition 2.1 
and Lemma 2.4 as before. Therefore, we may assume that § n Is the section listed in 
Lemma 2.4(ii) as an exceptional case. If D contains a curve with multiplicity 9, then 
D=9L, +3(L,+...+L,.), where L(1 SiS 6) are lines in M satisfying: 
L,°L; = \(j 2 2), Lj: L; = 0 for i, j 2 2. It follows that there are exactly sixteen 
such divisors of Ky°. If D does not contain any curve with multiplicity 9, then 
D = 6(L, + L, + E), where L,, L, are lines in M and E is a curve of degree 
2 satisfying: L,, L,, E intersect to each other at a common point. There are exactly 
40 such sections. We will call a section described as above the one of special type in 
H°(M, Ky°). Take any two different sections S;, 5; in H°(M, Ky°) described as 
above, by the fact that each point of M can lie in at most two lines, one can easily 
check the following estimate « < 3, 


J (S182) © )dV, < 00 (2.32) 
M 
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If Sy_, is not a section of special type in H°(M, Ky°), then by lemma 2.4(ii) and 
Proposition 2.1, fora <%+e 


lim (ay -1()31(a,i)) < lim § |Séy-1> Vy, =f WSv-al dy <0 (2.33) 
M 


im a i> aM; 
If Sy_; is a section of special type, by Proposition 2.1 and (2.32), we have that for 
as#+e<} 


lim (Ay - 131 (@, i) S lim f (|Shy—1 1]? + ISowll?)% dM, 
i-a i> oo M; 
$26 lim f |Siy-iStwil* dV, 


io M; 
= 26 f Sy_,Syll © dV;, < 0 (2.34) 
M 
Now (ii) of this lemma follows from (2.33) and (2.34). 


Lemma 2.6. Suppose that M is one of complex surfaces of form either CP? # 5CP? or 
CP? # 6CP? with positive first Chern class. Then we have 


sup 9; S — 5 ‘log(dy - 1(i)) + C (2.35) 
Mi 
where 6, C are constants independent of i. 


Proof. By Lemma 2.2, 2.4, there are two constants ¢ > 0 and C’ > 0 such that for 
all i 


J e~ (§+*)(%-se.)av, < C’hy 173-3 (2.36) 
Mi 


Using the equation (1.1),, we can rewrite (2.36) as 


é 


j el5+s)eure+(5-<)ouay, < CemPh- dy s(J9-3 2.37 
Mi 


where f; =f, are given in (1.1),. By the concavity of logarithmic functions, we 
obtain 


(2 + 3e)supy, @; S — (1 — 3e)infy, 9; — 4 + elogAy(i) + C” (2.38) 


where C” is a constant independent of i. On the other hand, it is proved in [T1] 
(also cf. [T2] for stronger form) that 


— info; < 2sup@g; + C” (2.39) 


Mi Mi 
where C’” is a constant independent of i. Then (2.35) follows from (2.38) and (2.39) 
by taking 6 = (62) '($ + «) and C = «7 '(C” + C’”). 


Corollary 2.2. Let M be given as in Lemma 2.5. If Ay-; +0, then M admits 
a Kahler-Einstein metric with positive scalar curvature. 
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Proof. Since Ay—, + 0, all numbers — log Ay - ; (i) are uniformly bounded indepen- 
dent of i. Then by Lemma 2.5, there are uniform C°-estimates of the solutions @,, of 
(1.1),,. So the corollary follows from the discussion in §1. 


Lemma 2.7. Let M be as in Lemma 2.5 and Ay-, = 0. Then there is an &’ > 0, such 
that for any solution @; of (1.1),,, we have 


~ inf, $ (2 —¢)sup + C (2.40) 
M; Mi 


where C is a constant independent of i. 


Proof. We define two functionals first considered by Aubin in [Au] (see also [BM], 


[T1]) as follows, 
iss.) 


2n 


where the metric g; is just g,. Note that g; converge to a Kahler metric g on M. 
Then by the proof for Proposition 2.3 in [T1], we have 


J (— ,)@2. < 1,(¢;) — J,(d;) (2.41) 
. | 55 ¢,. 


where g; is the unique Kahler-Einstein metric on M; and w,, = @;,. + 5 
i ” 


As in the proof of Lemma 2.2 in [T1], we compute 


I, — Jo sf kp: ‘56 0 ®, Ger +5.) 


+ J P(@5, — 0,)(5er, * 5s) 


ae _2 2 : 2 ie: isa), I Sy 
nae 3) P05, * 3) $05, 3) an 0g; A 0¢; A 035, 
(2.42) 


It follows from this and (2.41) that 


J (— $,)o2 S 2sup ¢, -~—— i 09; A 69; A @5, (2.43) 
Mi Mi 


Take a smooth point x,, on the zero divisor D of the section S$, in M, where N = N, 
and v = 6. Let x; be on the divisor {Siy = 0} in M; such that lim; .. ,, x; = x,, as M, 
converge to M. Let n > 0 be small. Then one can choose neighborhoods U,; of x; 
in M;, U,, of x,, in M and local coordinates (z;,w;) at x;, (z,w) at x,, such 
that x; =(0,0)EU; = {|z| <n, |wi|<n}, x. =(0,0)EU, = {lz| <n, |w| <n}, 
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lim; 2; = 2, lim;.,, w; = w and w, = Siy in U,, w = Sy in U,,. Then for i suffi- 
ciently large such that Ay _ , (i) < n*, by the choice of the above (z;, w;), one can have 
the estimate 


Jai are eee sae 
a eae atog( : 12053) ro og( y 1205417.) dW, 
Mi p=0 p=0 


C_* (Iwi? — Céw-1 (0) 
mien __ (Iwi? + Clay-s 0? 


Vani) < |wil < Y/2y- 
2 — e’log(Ay-1 (i) 


where C, e” > 0 are some constants independent of i. 
On the other hand, by Lemma 2.2, we have 


| ees “ = oi 
uf (24, A Op; — Blog| Y |AgliS vell3, 
2n Mi B=0 


N 
AO log( > 1203.) A W;, 
p=0 





dw; A dw; A dz; A dz; 


Mi 


/ Sa N 
x (, + 2w,;, + *2Blog( Yd lApSip i3)) 
p=0 


Ss J $; — sup $; — log( MY i203, 
Mi B=0 


2n 
< C for some constant independent of i 


Recall that — infy, ; is dominated by the average {4,(— ;)@? (cf. [T1]). Then it 
follows from (2.41) and the above inequalities 


— infd < 2sup @; + e"log(Ay_,(i)) + C’ (2.44) 
M; Mi 


where C’ is a constant independent of i. Now (2.40) follows from (2.44), Lemma 2.5. 
Now our main theorem follows from Corollary 2.1, 2.2, Theorem 2.1 and 
Lemma 2.5(i) and Lemma 2.7. 


3. An application of Gromov’s compactness theorem 


In this section, we will apply Gromov’s compactness theorem ([GLP], [GW]) and 
Uhlenbeck’s curvature estimate for Yang-Mills equation to studying the degener- 
ation of Kahler-Einstein metrics for compact complex surfaces in 3,(5 < n < 8). It 
is the first step towards the proof of Theorem 2.2 (strong partial C°-estimate). The 
more general version of the result in this section, ie., Proposition 3.2, is stated in 
[An] and [Na]. But for reader’s convenience and our own sake, we include 
a complete and independent proof here for our special case of Kahler-Einstein 
metrics. 
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Let {(M;,g;)} be a fixed sequence of compact Kahler surfaces in 3, with 
positive first Chern class and K4hler-Einstein metric g,, where 5S n< 8. We 
normalize each metric g; such that Ric(g;) = @,. 

For each Kahler-Einstein manifold (M,, g;), one can define a tensor T(i) on M,, 
which measures the deviation of Kahler manifold (M,, g;) from being of constant 
holomorphic sectional curvature. In local coordinates (z,, z,) of M;, define 


T(i)ap 5 ae R(i) 555 oa 3 (Ging ins PB Giant Ginp ) . (3.1) 
(1 Sa, B, y, 6 S 2) 
where R(i) denotes the bisectional curvature tensor of the metric g;. 


A straightforward computation as in [Y2] shows the following equality for 
each (M,, g;) with M; in 3, (3 Sn S 8), 
J IT@IN3,aV,, = $BC,(M,) — C7(M,)) = $9 — n). (3.2) 
Mi 


where ||7(i)||,, is the norm of the tensor 7(i) with respect to g,, that is in local 
coordinates (z,, Z>), 


TNFa) = oF of Gi? of? TWag)5 THa 55°) - (3.3) 
One may also see [Ban] for reference of (3.2), too. 


In particular, it implies that the L?-integral of ||R(i)||,, is uniformly bounded 
from above by a uniform constant. 


Lemma 3.1. Let (M,;, 9;) be a Kahler-Einstein surface given as above. Then there are 
uniform constants C', C” such that for any f in C‘(M,, R) 
1 
2 
c(J iitar, —C" J fav, s J IVEI7aV, (3.4) 
mi Mi Mi 


where Vf denotes the gradient of f. 


Proof. Since Ric(g;) = @,, and Vol,,M; = 9 — n is a constant, the lemma follows 
from a combination of results in C. Croke [Cr] and P. Li [Li]. 
The following lemma is essentially due to K. Uhlenbeck [Uh2]. 


50 
Lemma 3.2. Let N be the integer | cp 
in (3.4), [a] denotes the integer part of the real number a. Then there is a universal 
constant C 2 0, such that for any re(0, 1) and any Kahler-Einstein surface (M;, g;) 
given as above, there are finite many points Xi,,..., Xin in M; such that 

1 
J, C - 2 ¥ 
IR@|lg.(x) S 3 J IR@WsC)aV,,) for any xeM;\ \) B(x, 9;). (3.5) 
p=1 


B(x, 9i) 


| + 1, where C’ is the Sobolev constant given 


where B,(xjg, g;) is the geodesic ball with radius r and center at xi, and ||R(i)|\g, is the 
norm of R(i) with respect to g;. 


Proof. A straightforward computation shows 


— A (IRWllo,) S IROIg, + KURW|lg.)? 
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where A,, is the laplacian of g; and y is a positive constant independent of i, which 
actual value is not important to us. Define 


E,= |xeM, f IROIRAY, 2} (3.7) 
Br(x, 9:) 
Then by (3.2) and the well-known covering lemma, E; can be covered by N geodesic 


balls of radius _ Take xj,,..., Xiy to be the centers of these balls. Then for any 


xe M;\\3= 1 B,(Xig, 9:), 


Jf IR@INZ.4dV,, = € (3.8) 
Br(x, 9:) 


Let 7:R'. > R'. = {teR*|t = 0} bea cut-off function satisfying n = 1 fort < 1; 
n = 0 for t = 2 and |n’(t)| < 1. 

For any xe M,\\_)}=1 B,(xig, g;), denote by p,(-) the distance function on M; 
from x. 


8 
Put f = ||R(i)||,,- Multiplying n ( “es) f on both sides of (3.6) and then integra- 
ting by parts, one obtains 
J WWinf)Pdv,, < fn? f7dv,,+ J |\WnPf7av,.+ Jn’?f*dv,, (3.9) 
M-i Mi Mi Mi 


By Lemma 3.1 and H6lder inequality, 


1 


e(J instar, ) —C" j nfPav,, sf (r+ ant \israr, + 


Mi 


(5 instar, } ( j \sPar,) 
me Br(x, 9) 


Therefore, for some universal constant C = 0, we have 


1 
\f\*aV, iF < \f\?aV,, (3.11) 
Gr. We rc’ — Je) Br ga 


Similarly, by multiplying 77f? on both sides of (3.6) and processing as above, we 
have 


1 
2 % 
j ifPav,, <———~ f Ifiav, (3.12) 
(5 4) ; r(C’ — ./e) & #(x, 91) A 
Combining (3.11) and (3.12), and letting « < 4(C’)’, 


1 1 

ee z 
( j ifrar,,) sS(_J \sPav,, (3.13) 
B(x, 9:) BE (x, gi) 


Then (3.3) follows from Moser’s iteration as in the proof of Theorem 8.17 in [GT]. 
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r if 


We further observe that we may take the set {x4,..., x4} contained in the 
union of the balls B,(xj,,g;). Let {r;};2, be a decreasing sequence of positive 


1 r;_ : : : 
numbers such that r,; < ari < ig and if we write x/, as Ry and define 


Q] = M;\ Jp =1 Ba, (ip, 91) (3.14) 


af <a)"1(“H) and | Ql = Mj\ fxn, ~~~» Xn} 


where Xig = lim; X/p forany | <f<N, 
Qi** (e) = {xe Q/*" |dist,,(x, 0Q/**') > e}. 

The following proposition is essentially a special case of the famous Gromov’s 
compactness theorem (cf. [GP], [GW)]). 


Proposition 3.1. Let {(X;,h;)} be a sequence of n-dimensional Kahler-Einstein 
manifolds (maybe noncompact) and Q; be a sequence of domains in X ; with boundary 
0Q; for each i = 1. Suppose that all i, 


(i) The norm ||R(h;)|\,,(x) of the bisectional curvatures R(h;) are uniformly bounded 
for x in Q;. 
(ii) InjRad(x) 2 C for xEQ; and some uniform constant C. 
(iii) OS C’ S Vol,,(Q;) S C” for some uniform constants C’, C”. 


Then given any ¢ > 0, there is a subsequence {Q;,(€), hi,.}x > of Kahler-Einstein 
manifolds {Q,(e),h;}i>1, where Q;(e) = {x €Q,|dist,,(x, 0Q;) > €}, and a Kahler- 
Einstein manifold (Q.,,(€), h,,) such that for the compact subset K < Q.,,(€), there is an 
é’ > such that for k sufficiently large, there are diffeomorphisms ¢,, of Q;,(¢') into 
Q.,,.(€) satisfying 
(1) K < @,(Q,(€)) for any k = 1. 

(2) (;,')*h;, converge uniformly to h,, on K. 
(3) (bi,)y Jig (Pi, ')y Converge uniformly to J,, on K, where Ji,, J,, are the almost 
complex structures of 2;, 2.,(€), respectively. 


Proof. By some standard computations and the assumption that (X;,h;) are 
Kahler-Einstein manifolds, the bisectional curvature tensor R(h;) satisfies a quasi- 
linear elliptic system. The assumption (i), (ii), and (iii) imply that the Sobolev 
inequalities hold on Q,(¢) with uniform Sobolev constant. It follows from some 
well-known elliptic estimates (cf. [GT], [Uh1]) that 


|D'R(h;)\ln(x) S CY), 1=1,2,..., 0. (3.16) 


where D'R(h;) denotes the | covariant derivative of R(h;) on Q; and C(I) are 
uniform constants depending only on |. Then by Gromov’s compactness theorem 
([GP], [GW)]]), there are a subsequence {(2;,(¢), h;,)} and a Riemannian manifold 
(Q,,(e), h,,) such that the above (1) and (2) hold. Let K be any compact subset in 
Q.,,(e) and ¢;, defined as in the statement of this proposition. For the almost 
complex structure J, on Q,,, it is clear that (¢,,), °Ji;(@;, '), is an almost complex 
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on K. By taking subsequence of {i, }, we may assume that (¢;,), * Ji, "(;, ') converge 
on K. Since K is arbitrary, we obtain an almost complex structure J,, on Q,,(¢). It is 
easy to check that this J,, is integrable and h,, is a Kahler-Einstein metric with 
respect to this J,,. 

Combining this proposition with lemma 3.2, we have the following corollary. 


Lemma 3.3. Let {(M;,9;)} be the sequence of Kahler-Einstein surfaces in Theorem 

3.1. By taking a subsequence of {(M;, g;)}, we may assume that (M;,\{Xig}1<p<n>9i) 

converge to a Kahler-Einstein manifold (M,,,9,,) in the following sense: for any 

compact subset K < M,,,, there isar > 0 such that there are diffeomorphisms @; from 

M,\\)}=1B,(xig, g;) into M,, with K in the images and satisfying: 

(1) (6; ')*g; converge to g,, uniformly on K. 

(2) dix °J;°(G; '), converge to J,, uniformly on K, where J;, J,, are the almost 
complex structures of M;, M,, respectively. 

Moreover, the limit M ,, has only finite many connected components and the curvature 

tensor R(g,,) of 9. is L?-bounded by a universal constant. 


Proof. For any j 2 1, by Lemma 3.2, the curvature tensor R(i) of g; are uniformly 
bounded on the domains Q/ in (3.14), and Vol,,(Q/) uniformly approximte to 
(9 — n)x?. Since Ric(g,) = @,, for all i, the diameters diam(M,,g;) are bounded 


from above by /3n. By Volume Comparison Theorem [Bi], we have for any 
0<r<./3n and xeM,, 


Vol(B,(x, g;)) = cr* (3.17) 


where c is a uniformly constant. Thus by the estimate on injectivity radius in 
[CGT], we prove that those assumptions (i)-{iii) in Proposition 3.1 are satisfied by 
(Qi,g;), i,j21. Then by Proposition 3.1, we have a sequence of open 
K4hler-Einstein surfaces (Q4,, gi,). By the properties (1}3) in that proposition, we 
can naturally identify Q4, with a domain in Q/*' such that the restriction of gi*' to 
Qi, is just g/,. Thus we glue {(Q/,,g/,)};>, together to obtain the required 
(M ,,,9..) with properties (1) and (2) as stated in this lemma. It is clear by Fatou’s 
lemma that R(g,,) is L?-bounded by the universal constant for the L?-bounded of 
R(g;). The finiteness of the connected components of M ,, follows from Lemma 3.4 
we will prove in the following. 

Let p; be the distance function on M; x M,; induced by the metric g;, and p,, be 
the limit of p;. Note that to make p,, = lim p; meaningful, we may need to take the 
subsequence of {i}. Obviously, this function p,, is a Lipschitz function on 
M,, x M,,. Also for each B between 1 and N, the function p(x;g) converge to 
a Lipschitz function p..g. According to [GLP], one may attach finite many points 
Xotr+++sXon to M,, such that M, U{x.1,..., Xan} becomes a complete 
length space with length function p,, extending that p, on M, x M,, 
Pao(X ap, ‘y= Pols Xap) = Pop: 


Lemma 3.4. For any r > 0, put E,(r) = {x€M,,|Po(x) <r}, then there is a con- 
stant L independent of r such that the number of the connected components in E,(r) is 
less than L for any 1 SBEN. 
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Proof. By the construction of M.,,, it is easy to show that any point in E,(r) can be 
connected to a point in E,(r’) by a path within E,(r) for any r’ > 0. Thus it suffices 
to prove the lemma for sufficiently small r. Choose ry > 0 such that for r< ro, 
E,(r) 0 Eg(r) = @ for B + B’. By Volume Comparison Theorem [Bi] and positiv- 
ity of the Ricci curvatures of (M;, g;), by taking limit of B,(xig, 9;), Br (Xig, g;) etc., as 


i goes to infinity, we have for 1 < B<N, 
Vol, ..(Eg(r)) S Cr* (3.18) 
Voly.o(BE(X, 9.0) = Co tr* for xede,(5) (3.19) 


where C is some constant independent of r. 
Put L = [C”] + 2. We claim that the number of connected components in E,(r) 
is less than L. In fact, if not, by taking r smaller, we may have y,,..., y, in 


different components of 0E,(5) such that Br( VisIa) Br( Vi'sGo) = OD forj +j’ 
and B(Y;, 9) < E,(r). Thus by (3.18) and (3.19), we have 


L 
CURLS Y Volga (BEY js 9a)) S VOlgo(Es(r)) S Cr* 
j=1 


ie. L < C*. A contradiction. Therefore, our claim is true and the lemma is proved. 


Lemma 3.5. There is a decreasing positive function e(r), satisfying lim, . 9¢(r) = 0, 
such that for any point x in M,,, we have 


IR(.)N(%) $ ey 
where r(x) = min; <j <n {Pa(Xwjs X)}- 


Proof. It simply follows from Lemma 3.2 by taking limit on i and using Lemma 3.3. 


1 1 
Denote by aj k) the truncated ball <z i < |z| < k> in euclidean space C?. 


Put A* = | ),>,>04(4r’, 2r’), then 4 is the punctured ball in C? with radius r. Also 
denote by g, the standard euclidean metric on C?. 


Lemma 3.6. Let E be one of connected components in \_)§=1Eg(ro), where ro is 
chosen as in the proof of Lemma 3.4 such that E,(ry) 0 Eg(ro) = & for B + . Then 
there are af >0 and a diffeomorphism @ from A} into the universal covering E of 
Eo (Jj =1£,(*) such that the covering map tp:E—E is finite and for r = ?, 


max |(%7g0)* 9. — Grlg, S &1 (7) (3.21) 
4? 
where €,(r) is a decreasing function of r with lim,.., €,(r) = 0. 


Proof. For any integer k 2 2, kr < ro, we define an open manifold D(r, k) with 
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Kahler metric g(r, k), 


D(r,k) = En U & g(kr) \e,(; )). 


1 
g(r, k) = 72920 |Der.&) 


Then by Lemma 3.5, 
IR(g(r, k))\l oer, &) S k? (kr) (3.22) 


Claim 1. For any fixed integer k > 0 and any sequence {r(i)};. , with kr(i) < rp and 
lim r(i) = 0, there is a subsequence {i,} of {i} such that Kahler-Einstein manifolds 
(D(r(i;), k), g(r(i;), k)) converge to a flat Kahler manifold D,,_,. Here the meaning of 
convergence is as that in Lemma 3.3. 

This is simply a consequence of Proposition 3.1 and (3.22) and the fact that each 
(D(r, k), g(r, k)) is Kahler-Einstein. 

For simplicity, we assume that the subsequence {r(i,)} is just {r(i)} in the above 
claim. By the diagonal method and taking subsequence of {r(i)} if necessary, we 
may assume that for any k’ = 2, (D(r(i), k’), g(r(i), k’)) converge to a flat Kahler 
manifold D,,,,.. We can naturally identify D,,,, as an open set of D,, ,» if k’ < k”. 
Thus each manifold D,,,, in claim 1 is contained as open subset in a flat Kahler 


manifold D,, = Ue >2D~,x'. AS before, the distance function of the dilated 


es 
rie” 
metric = g(r(i), k) converge to the distance function p, of the flat metric g, on D,,. 


1 
Let E be in E,(ro), then rp? Pz, also converge to a Lipschitz function, formally 


r(i 


denoted by — ). One may think o as an attached point to D,,. Note that 
Do. = D 
oy {zeD.j oe) k 


< p,(0, z) < kt. Let D,, be the universal covering of D,,. Since 
D,, is flat and simple-connected, we may assume that D ,, is an open subset in C?. 


Claim 2. The fundamental group 7, (D,,) is finite. In fact, the number of elements in 
m,(D,,) is bounded by a uniform constant. 

By the construction of D,,, it is easy to find a point y in D,, with p,(0, y) = 1 and 
a geodesic ray y in D,, such that y(1) = y and p,(0, y(t)) = t. For any R > 0, define 
a modified geodesic ball of radius R > 0 by 


R(y(3R), gp) = {z€D,,| pp(y(3R), z) < R and J a unique 
geodesic jointing z to y(3R)} (3.22) 


1 ; 
Then the closure of BR(y(3R), g,) is the limit of the balls Ba( sun 20 ) in 


Ec E,(ro), where all yip lie on a geodesic yy < E, whose dilations by r(i)~* 
converge to the previous ray y as i goes to infinity. It follows from Volume 
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Comparison Theorem [Bi] that 


Vol,r(BR(y(3R), 9p)) = Volgr(Br(y(3R), gr)) 


1 
= lim Volpe (BR vn oe) > CR* 


where C is a uniform constant. Let 7 be a lifting of y to 5. such that 
n( (1)) = (1) = y, where n:D,, — D,, is natural projection. Also 2(}(3R)) = y(3R). 
Since BR(y(3R), Gr) is contractible by definition, there is an open subset Bp & dD, 
such that |g is an isometry from B rz onto BR(y(3R),g,). In particular, 
Vol,-(Br) = = CR* with C given above. Any element a in 2, (D,,) can be considered 
as a deck transformation on dD, . By definition of Br, we have o(Br) fa) B, = J. 
Denote by Bp-(j (1)) the standard ball in C? with center at 7 (1). Then 


(362) R* = Volgr (Berl (1)) 2 z Vol,(o(Ba)) 


dist(o(F (1), 3(1)) < R 
> CR*: # {En,(D,,)|dist(o(F (1)), 5(1) < R} 
By letting R go to infinity, we conclude 


36m)" 
#(cex,,)} so a < 
Claim 2 is proved. “i 
Any element in z,(D,,) is an isometry of the open subset D ,, in C?. Thus 2, (D,,) 
can be considered as a subgroup in the linear automorphism group of C?. Since 


m,(D,,) is finite, we may further assume that 7, (D,,) is in the unitary group U(2). 


Claim 3. The Kahler manifold D,, < C? coincides with C?\{o}. Moreover, the 
pullback 2*p,(0,-) coincides with the euclidean distance function from the origin 
in C?. 


We adopt the notations in the proof of Claim 2. Let q = lim,.. +9 7(t). Let dD, be 
the closure of D,, in C?, and peD,, \D, . Then there is a sequence {p;} ¢ D,, ~ 
that p=limp, in C*. It is clear that {x(p;)} has no limit point in Di.» 8 
lim) « Pr(0, m(p;)) = 0. Each x(p;) can be connected to a y(t;) by a path y; at 
length I(y;) and lim;.. . [(y;) = 0. Thus for each j, there is another lifting p, of x(p,) in 
D,, such that lim;.,.p; = q in C?. For each j, there is a a; j€%,(D,,) such that 
p; = 0,(;). By taking a subsequence of {j} if necessary, we may assume that all ; 
are the same, denoted by o. Then p=oa(q). Thus we proved that 
D,, = C?\n,(D,,):q. Let o be the origin of C?, then o¢ D ,, since 2, (D,,) < U(2) acts 
on D,, freely. It follows that gq = 0 and D,, = C?\{o}. 


Claim 4. For any ¢€(0, 1), there is a r,>0 such that for any r>r,, there is 
a diffeomorphism ¢, from A (sr, 2r) into 2; '(D(r, 2)) with its image containing 
nz '(D(r, 2 — «)) and 


1 
max} Ita. — Gr lle (x)|Ix€ 4 (Fr. ar) Se (3.23) 


where g;, is induced by the euclidean metric on C?. 
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We prove it by contradiction. Suppose that the claim is not true, then there is 
a sequence {r(i)} with limr(i) = 0 such that for any r(i) no diffeomorphism with the 
above properties exists. But by previous three claims, we can weg find a subsequ- 


ence of {r(i)}, for simplicity, say {r(i)} itself, such that (v (2, r(i)), rp? a=) converge 


to A(%, 2)/T in D,, = C*\ {0}/T for some finite group I ¢ U(2) with # I’ < C, where 
C is a uniform constant given in Claim 2. Since the estimate (3.23) is invariant under 
scaling, by the definition of the convergence given in Proposition 3.1, we may have 
the diffeomorphisms ¢; from A($r(i), 2r(i)) into mg ‘(D(r(i), 2)) for i large satisfying 
(3.23) above. A contradiction. We proved this claim. 

This above claim implies immediately that there is a decreasing function ¢’(r) on 
r with lim,.. .¢'(r) = 0, such that for any r < r,, we can replace ¢ by e’(r) in (3.23) of 
Claim 4. 

It remains to glue all ¢, together to obtain the required local diffeomorphism 
@ in the statement of our lemma. Put r, = 47, r; =47;-, for i= 2, where 7 is 
sufficiently small. Let ¢;=¢,, be the diffeomorphism from A(4r;,,2r;) into 
nz ‘(D(r;, 2)) given by Claim 4. Then for any i = 2, the composition $;_'; © @, is 
a diffeomorphism from (z,°¢;)~‘(D(r;,2)(ri-1,2)) onto (m~o;-1)7! 
(D(r;, 2) 0 D(r;- 1, 2)) and satisfies 


sup { ||(Pi-1 ° b:)* Or — Gr Ilo, (x)1x€ (2° ;)" *(D(r;, 2) 0 D(r;-1, 2))} S 4e'(r:-1) 

(3.24) 

sup {\l(Gi *° i-1)*9r — Grllo,(X)1X €(te° Gi-1)” \(D(F;, 2) 0 D(r;-1,2))} S 4e'(ri-1) 
(3.25) 

By (3.24) and (3.25) and letting 7 small enough, one can easily modify ¢;_', o ¢; to be 

a smooth diffeomorphism y; from (2,0 ¢;)~ '(D(r;, 2) 0 D(r;- 1, 2)) into A¥ such 

that 

y= oe of; in (m0 ¢;)* ons 1,2) D(ori- 1, 2)) 
oe. in (t,0 9) *(D(r;, 2) 0 D@r;-1, 2)) 


and the estimates 


sup {WF ge — Grllo,|X€(%_°O;) (Dr, 2) 0 D(ri-1, 2))} S 400e(r;-1) (3.26) 


Now we define a diffeomorphism $:4* > E by 


| a(ér,,2r,) =, Placr,, t,) = ;(i 2 2) 
Platgrie1,r,) =$°Wi+, for i21. 


Then ¢ satisfies (3.21) for some decreasing function e(r) with lim,.9¢,(r) = 0 
The finiteness of 2, follows directly from Claim 2. The lemma is proved. 

By this lemma, we can compactify M,, topologically by adding a point x,,g to 
E,(?) for each B between 1 and N. Denote by M,, the compactification of M,, 
Then M ,, has the following properties: for any Xaog, there is a neighborhood U, of 
Xog in M, such that any connected component Ui(1 < <j <l,) of UNM, 
covered by a smooth manifold U,; with the covering group r Bi isomorphic * 
a finite group in U(2), and U,,; is diffeomorphic to a punctured ball 4¥ in C?. Let 
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op; be the diffeomorphism from A¥ onto U,; and 7; be the covering map from Us, 
onto U,;. Then by Lemma 3.6, the pull-back metric Pj;°7f;(g,,) extends to 
a C°-metric on the ball 4; with the estimate (3.21). Note that the metric 
$3; ° f(g...) is an Einstein one outside the origin. 

Such a M ,, with the metric g,, is called a generalized topological orbifold with 
C°-metric g,,. The previous discussions in this section yields. 


Proposition 3.2. Let {(M,;, 9;)} be a sequence of compact Kahler-Einstein surface in 
%,,(5 Sn < 8) as given at the beginning of this section. Then by taking a subsequence 
if necessary, we may assume that (M,, g;) converge to an open KGhler-Einstein surface 
(M,9.) with M,, = M,,\{Xap}i<p<n in the sense of Lemma 3.3, where M,, is 
a generalized topological orbifold such that g ,, can be extended to be a C°-metric on 
M.,, described as above. 


The differential structure on M ,, can be extended to M ,, and the extension may 
not be unique. But there is at most one with which the metric g,, on M,, can be 
extended smoothly to M. In next section, we will prove that there is such an 
extension by using Uhlenbeck’s theory of removing singularities of Yang-Mills 
connections. We would like to point out that Proposition 3.2 also holds for 
a sequence of real 4-dimension Einstein manifolds as claimed and proved in [An] 
and [Na]. We refer readers to these papers. 


4. Removing isolated singularities of Kahler-Einstein metrics 


In [Uh1], K. Uhlenbeck invented a beautiful theory of removing isolated singular- 
ities of Yang-Mill connections on real 4-dimensional manifolds. The purpose of 
this section is to apply this theory of Uhlenbeck to the Kahler-Einstein metric g, 
on M., constructed in the last section and prove that g,, can be smoothly extended 
to the generalized topological orbifold M,, with some differential structure (cf. 
Proposition 3.2 for details). The latter M,, is considered as a compactification of 
M,, and the complement M ,,\M.,, consists of finitely many points {x..g}1<p<w- 

Let Us; be any connected component in U,AM,(1 SBSN,1 Sj S|,), 
where U, is a small neighborhood of x.g in M,,. Recall that each Ug; is covered by 
A¥ in C? with the covering group Ig; isomorphic to a finite group in U(2) and 
1$\9.. extends to a C°-metric on the ball 4; with the estimate (3.21). The smooth 
extension of g,, to M,, is local in nature. Therefore, we may 


Fix B and j (1 <8 < N,1 Sj S1,) and denote x§,g,, by g for simplicity. We 
need to construct a homeomorphism y of 4; into itself, such that the restriction of 
W to AF has its image in A¥ and is C®-smooth and w*g extends smoothly across the 
origin in A*. 

The first step towards this goal is to prove the boundedness of the curvature 
tensor R(g). The proof here is identical to that for Yang-Mill connections in [Uh1] 
with some modifications. However, for reader’s convenience, we include a sketched 
proof here. We will just consider 4¥ as a real 4-dimensional manifold for being, 
where 7 is given in Lemma 3.6. In the proof of Lemma 3.6, we observe that by the 
definition of the metric g, we may choose the diffeomorphism ¢ = ¢,; properly 
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such that for 7 sufficiently small, the following estimate hold, 
f 


Idgijller(x) <2, 
r(x) 


! i 9) < 10) xed? Si RSA 


Ox, 
PG 
A\ os .ax, 


where d is the exterior differential on C? = R*, ||- ||,¢ is the norm on 7'R* with 


xeA¥, 1Si,j, <4 





: 7 an 
respect to the euclidean metric g, and g;; = (x rey S =) for the standard coordin- 


ates (x,, X2,:%5, %4) for R*. 

Let A be the connection form uniquely associated to the metric g on 4¥, that is, 
D =d+A is the covariant derivative with respect to g. Clearly, we can regard A 
as a function in C':*(4¥, so(4) x R*) for «€(0, 1). 

The following lemma is essentially Theorem 2.8 in [Uh1]. 
Lemma 4.1. Let 7 be sufficiently small. Then there is a gauge transformation u in 
C*(A(r, 2r), so(4)) satisfying: if D = e~*- D -e“ = d + A, then d*A =0 on A(r, 2h), 
dj A, =0 on OA(r, 2r) and fav. on A(Ver(x))dV, = 0, where d*, dj are the adjoint 
operators of the exterior differentials on A(r,2r) or OA(r, 2r) with respect to g, 
respectively, and V, denotes the standard gradient, dV, is the volume form of g. 


Moreover, we have sal ) 
sup (||All,(x)) $2 (4.2) 


Mr, 2r) 


where €,(r) is a decreasing function on r with lim,..9€,(r) = 0 


Proof. As in [Uh1], the proof follows from an application of Implicit Function 
Theorem. For reader’s convenience, we sketch a proof here. 


1 
By scaling, we may take r = 1 and Q = A (1, A (1, 2) with the scaled metric <9 is 


sufficiently close to the flat metric g,; on Q if r is small enough. Let C?-*(Q, Tt) 
be the collection of C?:*-smooth covariant symmetric tensors on Q. Then for any 
heC?*(Q, S?T§) sufficiently close to the zero tensor, we have a new metric 
gr +h = g,, consequently, it induces a unique so(4)-connection A, on Q. As we 


have pointed out in the above (4.1), the difference of the scaled metric 59 from g, is 
small in C?:*(Q, S*7$) whenever r is small. We define operators 
Q:C32'*(Q, so(4)) x C?*(Q, S?T§) + C*(Q, so(4)) x C$-*(AQ, so(4)) 
(u, h) > (df(e “de* + e~“A,e"), diy(e "dye" + @ “Anye”)) 
f:C3:*(Q, so(4)) x C?:*(Q, S*?T¥) > so(4) 
(u, h) > f (e-“de* + e~“A,e")(Vr)dV, 
a 
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where 0 < « < 1, the subspace C$“(-,-) consists of all functions orthogonal to 
constant ones (k = 0, 2), and dj, di, are the adjoint operators of d, d, with respect 
to the metric g,, respectively. 


1 
To prove the lemma, it suffices to find a u such that (Q, f (u 739 — or) = 0. 


One can easily check that the partial derivative of the operator (Q, f) with respect 
to u is an isomorphism at the point (0,0), so the lemma follows from Implicit 
Function Theorem. 


Lemma 4.2. Let A be the connection for given in Lemma 4.1, then for r small, we have 


sup ||All,(x) $Cr sup ||R4|l,(x) (4.3) 


A(r, 2r) Ar, 2r) 
J Alé@0dV,< Cr? [Ry llkdV, (4.4) 
Ar, 2r) A(r, 2r) 
Proof. Both (4.3) and (4.4) are invariant under scaling. So it suffices to prove the 


1 , 
lemma on Q = A(1, 2) with the scaling metric =39- By Lemma 3.6, the metric 


1 ‘ 
729 converge uniformly to g, on 2 as r goes to zero. Thus by the proof of Corollary 


2.9 in [Uh1], we conclude that 


fldf li, av, 


A(r) = inf visage fEC?(Q, Tk: @ so(4)), d*f=0, dtf| =0, 
Sisila,av, 


a 
I ( Vr(x))dvi, =0 


has a uniform lower bound 4 independent of r. By the equation dA + [A, A] = 
DA = R,, where D is the covariant derivative associated to A, we have 


Aj \AllgdV,s f WldAlgdv,s2 f WRyllgdv,+2 § ILA, Alllgav, 
A(1, 2) A(1, 2) A(1, 2) A(1, 2) 


By the estimate on ||Al|, in Lemma 4.1, the last integral is bounded by 
Ce,(r)f 41, 2) | AllgdV, for some constant C independent of r. Then (4.4) follows 
when r is sufficiently small. 

On the other hand, by Lemma 4.1 and the equation dA + [A, A] = R,, we 
have 

I|4A || p(x) S || Ra llg(x) + Ce2(r) |All, (x) (4.5) 
where C is some uniform constant. Then (4.3) follows easily from (4.4), (4.5) and the 
1 S 

fact that d* A = 0 and the scaled metric 29 is close to the flat metric g, on Q ifr is 
sufficiently small. 
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Lemma 4.3. Given any 1 > 6 > 0, there is a r(d) > 0, r(d) < # such that 


IR(g)l(~) SG on Ara (4.6) 


r(x = 
Proof. The proof is essentially same as that of Proposition 4.7 in [Uh1]. So we just 
sketch the proof here. Choose a small r <7, put r, =5 r,= 3. ee , ata 
Let A; be the connection on A(r;,r;-,) given by Lemma 4.1. Then 
dy Aiyloatr,.r,.,) = dy Ai-1yleae,r,.,) =, it follows that the restrictions Aj, and 


A;-1y to 04, , are distinct by a constant gauge on 04, So we may assume 
that Aiyloar, = Ai-iyloar,.,- Put Q; = A(r;,ri:-1), then we have 


J |Ru,ll7 dV, = J (dA; + [A;, Aj], Ra,>,4V, 
) <D;A; i [A;, A;], Ra,>,4V, 
Q, 
ness J «[A;, A;], Ra,>,4V, Wie J «Ai, DF Ra,>,4V, 


— f <Aiys (Rau >g4F, + J <Aiys (Rarw>g40, 
S, S,-, 


where D; = d + A;, S; = 04,, and do is the induced volume form on S;, S;-;, ete. 
Because the metric g is Einstein and A; is equivalent to A by gauge transformation, 
we have D*R,, = 0. On the other hand, by (4.1) and Lemma 4.1, one can easily 


show that || A;||,(x) S ra Rall) S a for some constant C inde- 


pendent of i and x in 2;. Thus by summing equations (4.7); over i 2 1 and observing 
that (R4,)y = (E,,,,)ry on S;, we obtain 


JIR@ls dV, =f IR(g)|lzaV, 


i=1Q, 


Y fia ll2 av, 
i=1Q, 


~ y J (Raw [Av Ai }>,4V, + f <Awy, (Rar), dV, 


i=1Q, 


By Lemma 4.2 and the previous estimate on ||R, 1,09, we have 


» LA; Aj] >,4V,|| S C’sup(|Raj llg(x)) § Allg dV, 
Q, Q, 


S Ce,(r;) § Rai 4V, 
Q; 


where C, C’ are some constants independent of i. 
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1 ; , 
By Lemma 3.6, one can see that (04, 3 s) converge uniformly on (S°, g,), i.e. 


the unit sphere with the standard metric. Then by the proof of corollary 2.6 in 
[Uh1], one can find a decreasing function e’(r) on r with lim,..9¢’(r) = 0 such that 


f lAwlhsaV, $2 —e@)) 77? f WFadwillsdV, (4.10) 
04, 04, 


Combining (4.8), (4.9) and (4.10), we have 


J IR@)IgdV, <2—-eM) (1+ ceatr)r( j 
A, ad 


1/2 
(Raw \zar, ) 


r 


2 Q+e() 1+ C 
(f Haidar, ) sSFFO CLO | ro izar, 


r 





6 
si(1 + 5) J IR(g)\lg4V,. 
aA, 


whenever r(6) is sufficiently small and r < r(6). 
Then it is standard to conclude from above inequality that 


é 
) R(g)\lgaV, < r4-4 for r < r(d) (4.11) 
4, 


The estimate (4.6) follows from (4.11) and the fact that g is Einstein and close to the 
flat metric on 4;. 


With help of Lemma 4.3, we can now regularize the extension of the metric 
g across the origin in 4; < C?. 


Lemma 4.4, Let g, 4;, 9, have the meanings as above. Then if ? is sufficiently small, 


there is a self-diffeomorphism w of A¥ such that w extends to be a homeomorphism of 
A; and 


3 
IlW*9 — Orllgr(x) Sr(x? xe AF (4.12) 
1 
lId(W*g)\lar(x) S r(x)? xe AF (4.13) 


Proof. We first construct y, with properties analogous to (4.12) and (4.13) in the 
annulus A((3 — «)r, (3 + ¢)r) for some small ¢ > 0 independent of r. By scaling, we 


. , 
may construct w on A(3 — ¢,3 + €) c Q = A(I, 2) with metric “29 still denoted by 


g for simplicity. Then by previous lemma, if r <7 is small, we have 
7 
sup(||R(g)||,(x)) S r4 (4.14) 
2 


and also supp {||R(g)||,(x)} < «’, where e’ can be very small if we want. 
For any point xé 043, using the harmonic coordinates constructed in [Jo], one 


can find a diffeomorphism w, from the euclidean ball Bi(x) into Q such that 
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W.(B4(x)) is very close to Bi(x) in Hausdorff distance and 


sup{|V29 —drller(v> dE allgr(y)|yeBLUx)} < Cra (4.15) 
where C is a constant independent of r and x. 
Our yw, is obtained by gluing finitely many W x,(x;€ 043). We just sketch this 


gluing process here. Let (y,,¥2,)3,¥4) be the euclidean coordinates, then 


> 3 
0A3 = Jon ++ Vel | YS byl? = t. For any fixed a, b with a? + b* < 3, we 
i=1 
choose finitely many points x,,..., Xj on the circle S(a, b) < 0A3 consisting of all 


points (y,,)2,¥3,¥4) with (y3,y4)=(a,b) given above, such _ that 
BE(x))O Bi(x;) = © if |i — j| > 1 and the union of Bi(x;)(1 <i < N) contains the 


neighborhood B1(S(a, b)) of S(a, b). Note that the number N of {x;} is bounded 


independent of (y3, y,) and r. Now we glue —/,,, .. . , Wx, together as in the proof of 
Lemma 3.6 and obtain a diffeomorphism w, 5) from Bi(S (a, b)) into Q such that the 


estimate (4.15) holds for this diffeomorphism on Bis (a, b)). Note that the constant 


C may be different, but still independent of r. Next, fix b < 3, choose a,,..., ay: 
such that a,=—./3?-b? <a,<... <ay = /37-B* and 
BY(0, 0, a,, 6) m BL(S(a,,b))= OD for j 2 3; BL(S(a,, b)) BL(S(a;, b)) = OB for 


li — j| = 2; Br(S(a;, b)) a Bi(0, 0, ay, b) = @ for j < N — 2, also the union of them 
covers the neighborhood BA (S(b)) of S(b) = {(y1,¥25 Y3> Y4)EOA3| Ya = b}. Then 


we glue Woo, a,,5)> Yio, 0,a,,6) and those y,, »(2 < i < N — 1) construct in step one to 
obtain a diffeomorphism w, from B+ (S(b)) into Q such that (4.15) holds for wy, on 


BX (s(b)). Finally, we choose finitely many points b,,..., by. in the interval 
[ — 3,3] and repeat the above gluing process for B1((0, 0,0, — 3), B1((0, 0, 0, 3)) 
and B1(b;) for 2 <i < N” — 1. Wethen have the diffeomorphism y, from 4 (4, $3) 


into Q. By scaling, we may consider y, as a diffeomorphism from 4($r, $$r) into 
Q such that the image contains A((43 + é (r))r, ($3 — Z(r))r) in w and 


5 47 49 3 
sup ~ rd — Gellar), dwg \lgr(x)|xe4 30" 39" <Cr+ = (4.16) 


where é(r) is a decreasing function with lim,..9 é (r) = 0. 

Now let r, = 7, ri+1 = 3$r; for i= 1. We have constructed diffeomorphisms w; 
from A(%r;,1r;) into Q with properties described above. Then the required y is 
obtained by gluing these w; properly as in the proof of Lemma 3.6. The estimates 
(4.12) and (4.13) follows from (4.16) if 7 is sufficiently small. 


Lemma 4.5. Let g, 4; be as in Lemma 4.4. Then there is a diffeomorphism w from 
A¥ into A¥ such that w*g extends to be a C®-metric on A;. Moreover, if J is the 
almost complex structure on A¥ such that g is Kahler with respect to J, then 
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(w~*), J ow, extends to be an integrable almost complex structure on A; such that 
W,9 is Kahler-Einstein with respect to it. 


Proof. By Lemma (4.4), we may assume 


3 1 
9 — Gr llor(x) Sr(x)?,  lIdgligr(x) Sr(x)?_ on 4F (4.17) 


Then g is a C''*-metric on A;. Let x,,...,X4 be the euclidean coordinate 


functions on 4; and 
|4,x;|(x) S$ Cr(x)'7, xed; (4.18) 


where A, is the Laplacian of the metric g and C is a constant independent of x, 7. 
Solving Dirichlet problems for k;, 


A,k; = — 4,x; on 4; 
: ; 4.19 
Aa — 6; 


where 6, are constants of order O(7*) such that k,(0) = 0. By the standard elliptic 
theory [GT], we have C?:?-solutions k; of (4.19) such that sup,,(||dk; ||) = O(F *). 
It follows that (/,,..., 14), where 1; = x; — k;, is a harmonic coordinate system in 
A; with respect to the metric g when F is sufficiently small. Let y:4; > 4; be the 
diffeomorphism by mapping (x,,..., X4) to (I,(x),..., 1,(x)) and {g,;} be the 
tensor representing the metric y*g. Then {g,;} are C’’*-smooth and as in [KT], 
the Einstein condition on g implies 


1 67 4a;; 
- 5 gq A + lower order term = — g;; on 4; (4.20) 


r,s 


By elliptic regularity theory [GT], we conclude that {g;;} are C°-smooth. In fact, 
{gij} are real analytic. Now it is clear that py’ oJow, is extendable and w*g is 
a Kahler-Einstein metric with respect to the extended complex structure on 4;. 

Recall that M ,, is obtained by adding finitely many points to the limit (M,,, 9...) 
of the sequence of Kahler-Einstein manifolds {(M,, g;)} in Lemma 3.3. Summariz- 
ing the above discussions and using Proposition 3.2, we have actually proved that 
the compactification M,, of (M,,g,,) has the properties: for any added point 
x,,€M,,\M,, there is a neighbourhood U of x,, in M,, such that any connected 
component U,; of UUM.,, is covered by a punctured ball 4? in C? with the 
covering group isomorphic to a finite group in U(2). Moreover, if x;:4¥ — U; is the 
covering map, then n¥*g,, extends to be a Kahler-Einstein metric on 4; in C? with 
respect to the standard complex structure. Therefore, we have 


Proposition 4.2. Let {(M,, g;)} be the sequence of compact Kahler-Einstein manifolds 
given at beginning of this section. Then by taking a subsequence if necessary, we may 
assume that (M;, g;) converge to a Kahler-Einstein manifold (M ,, \Sing(M ,,), 9.) in 
the sense of Lemma 3.3, where (M,,,,9,,) is a connected Kahler-Einstein orbifold 
(maybe reducible) and Sing(M ,,) is the finite set of singular points of M,,. 


Here a complex orbifold is defined in the general sense as described before this 
proposition. Moreover, from now on, we will say that the sequence of Kahler- 
Einstein manifolds converge to a K&ahler-Einstein orbifold (M,,, 9,,) if the con- 
clusion in the above proposition is true for {(M,;, g;)}. 
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5. Application of L?-estimate for d-operators on Kahler-Einstein orbifolds 


Let {(M;, g;)}i21 be a sequence of Kahler-Einstein surfaces in 3,, with Ric(g;) = w, 
In previous two sections, it is proved that some subsequence of {(M,,9;)}i>1 
converge to a Kahler-Einstein orbifold (M ,,, g,,) in the sense of Proposition 4.2. In 
this section, we will apply L?-estimate for d-operators to studying the properties of 
this limiting orbifold M,,. We will prove that the plurianticanonical group 
H°(M,, Ky") converge to H°(M,, Ky") for any integer m > 0 as (M,, g;) converge 
to (M,,,9,.) and M,, is an irreducible normal surface with only rational double 
points and some special Hirzebruch-Jung singularities as singular points (cf. 
[BPV)). 
We first recall the definition of a line bundle on M ,, (cf. [Bai]). 


Definition 5.1. A line bundle on the complex orbifold M.,, is a line bundle L on the 
regular part M ,, \Sing(M_,,) such that for each local uniformization Ty: U, > M,, 
of a singular point p, the pull-back 2*Z on U p\%p ‘(p) can be extended to the whole 
U 


~ 

On the Kahler-Einstein orbifold M ,,, we have natural line bundles in the sence 
of Definition 5.1 such as pluricanonical line bundles K%, and plurianticanonical 
line bundles Ky™(meZ,). A global section of Ky™ is an element in 
H°(M,,\Sing(M,,), Ky"). Let H°(M,,, Ky") denote the linear space of all these 
global sections of Ky". Note that the metric g,, induces natural hermitian orbifold 
metrics h%, on Ky’. 


Lemma 5.1. Let {(M;,g;)} be the sequence of Kahler-Einstein surfaces given at the 
beginning of this section and S' be a global holomorphic section in H°(M;, Ky™) with 
Jus, S'IlZ,dV,, = 1, where m is a fixed positive integer. Then there is a subsequence {i, } 
of {i} such that the sections S** converge to a global holomorphic section S® in 
H°(M,, Ky). In particular, if {Sj }o< p<, is an orthonormal basis of H°(M;, Ky’) 
with respect to the induced inner product by g;, then by taking a subsequence, we may 
assume that {Sp}o<g<n, converge to an orthonormal basis of a subspace in 
H°(M,,, Ku™), where Nm» + 1 = dim-H®(M;, Ky”). 


Remark. Before we prove this lemma, we should justify the meaning of the 
convergence of {S‘} in the above lemma since these sections are no longer on 
a same Kahler manifold. Recall that Lemma 3.3 says: for any compact subset 
K < M,,\Sing(M.,,), there are diffeomorphisms ¢; from compact subsets K; < M; 
onto K such that (¢; ')*g; and $;,°J;°(¢; '), converge to g, and J, on K, 
respectively. Now with ¢, as above, we can push the sections S‘ down to the 
sections ¢;,(S') of @"(A?(T,M @ T.M)) on K. The convergence in Lemma 5.1 
means that for any compact subset K of M,,\Sing(M,,) and ¢; as above, the 
sections $;,-(S'*) converge to a section S* of Ky’ on K in C®-topology. Note that 
the limit S® is automatically holomorphic. 


Proof of Lemma 5.1]. Let A; be the laplacian of the metric g;, then by a direct 
computation, we have 


A;(I1S‘Il§,)(%) = |D,S'Il¢,(0) — 2mm ||S*lg,() (5.1) 
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where D, is the covariant derivative with respct to g,. Since fy, ||S‘|Z,(x)dV,, = 1, by 
Lemma 3.1 and applying Moser’s iteration to (5.1), there is a constant C(m) 
depending only on m such that 


sup (||S*[\5,(x)) S C(m) (5.2) 
Mi 


Let K be a compact subset in M ,,\Sing(M,,,) and @¢; be diffeomorphism from 
K; onto K as in the above remark. To prove the lemma, it suffices to show (*): for 
any integer | > 0, the I" convariant derivatives of ¢;,(S‘) with respect to g,, are 
bounded in K by a constant C; depending only on / and K. There is a r > 0, 
depending only on K, such that for any point x in K;,, the geodesic ball B,(x, g;) is 
uniformly biholomorphic to an open subset in C?. On each B,(x, g;), the section S, 
is represented by a holomorphic function f;,,. By (5.1), the function f,,, are 
uniformly bounded. Therefore, by the well-known Cauchy integral formula, one 
can easily prove that at x the / covariant derivative of S' are uniformly bounded 
by a constant depending only on /, K. It follows (*) since (¢; ')*g; uniformly 
converge to g,, in K. The lemma is proved. 


Remark. One can easily prove the existence of hermitian orbifold metrics on a line 
bundle as above by unit partition. The following proposition can be easily proved 
by modifying the proof of (THo] p. 92, Theorem 4.4.1) with the use of the 
Bochner-Kodaira Laplacian formula (see e.g. [KM]. 


Proposition 5.1. Suppose that (X,g) be a complete Kahler orbifold of complex 
dimension n, L be a line bundle on X with the hermitian orbifold metric h, and w be 
a function on X, which can be approximated by a decreasing sequence of smooth 
function {,};<1< +4 - Tf, for any tangent vector v of type (1, 0) at any point of X and 
for each l, 


. 2 
(20 hi 
J/-1 
where C is a constant independent of | and <, >, is the inner product induced by g. 


Then for any C® L-valued (0, 1)-form w on X with dw = 0 and |, ||w||?e~“ dV, finite, 
there exists a C® L-valued function u on X such that du = w and 


(Ric(h) + Ric(g)), v A r) > C\|lv||2 (5.3) 


g 


P 1 - 
J Iuli*e "dV, $ GJ lwil*e vdV, (5.4) 


where ||: || is the norm induced by h and g. 


Lemma 5.2. Any section S in H°(M ,,, Ky) is the limit of some sequence {S'} with S' 
in H°(M;, Ky”). In particular, it implies that the dimension of H°(M ,,, Km™) is same 
as that of H°(M,, K m.”"), that is, plurianticanonical dimensions are invariant under the 
degeneration of Kahler-Einstein manifolds with positive scalar curvature. 


Proof. We may assume that fy, ||S||2. (x)dV,.. = 1. Let {r;} be a sequence of 
positive numbers with lim;.. ,, r; = 0 such that for each i, there is a diffeomorphism 
¢; from M;\\_)f=1 B,,(xig, g;) into M,,\Sing(M,,) as given in Lemma 3.3, where 
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N is defined in Lemma 3.2 and (x;g) are defined in (3.14). Then @; satisfy (1) 
lim; . .. (Im(@;)) is just M ,, \Sing(M ,,); (2) (¢; ')*g; uniformly converge to g,, on 
any compact subset of M,,\Sing(M,,) in C®-topology; (3) $i, °J;°(¢; '), con- 
verge to J,,, where J;, J,, are almost complex structures on M;, M ,,, respectively. 
Define a cut-off function n: R' > R}, satisfying: n(t) = 0 for t < 1; y(t) = 1 fort = 2 
and |y'|<1. Also let 2; be the natural projection from the bundle 
@"(A*(TM; ® TM;) onto Ky” = @"(A?TM,). For each i, we have a smooth 
ni) t((d; '),S) of Ky™ on M,, where p;(x) is a Lipschitz 
function defined by p,(x) = min, < g< y {dist, (x, x;g)}. Then by the facts (2) and (3) 
above, there is a decreasing function ¢,(r) on r with lim,.9¢3(r) = 0 such that 


section v; = i( 


N 
sup { |]07:((Oi 4S) llo(XEM;\ ) Bars(Xig, 9:)} S €3(r1) (5.5) 
p=1 


J llolaeddy, S €3(r;) (5.6) 


Mi 
where 0, is the corresponding d-operator on M,. 
By (5.5), we have 


J lew illa xa V, 


N 
Se,(r,)Vol,(Mj)+ Yj a(n($:)): T(($i *)yS) "(x)dV, 
B=1 By, (xg, 9) i Gi 
N 


| 
a ¥ ip 4,3 VOl(Bar,(xip, 9:)) Sup {I(Pi*)4 S lig.) M; 
p=1 


\ U Bo,,(Xig, 9;)} + €3(r;) Vol,,(M;) (5.7) 
p=1 


As in the proof of Lemma 5.1, one may bound supy,, (|S \|2..(x)) by the constant 
C (m) in (5.2). Thus by (5.7), Volume Comparison Theorem and the convergence of 
(¢; ‘)*g; in the above fact (2), there is a constant C independent of i such that 


§ lw: lg.CddV,, S Clr? + €5(r;)) . (5.8) 


Mi 


Now applying Proposition 5.1 ie. L?-estimate of d-operators, we have 
a C®”-smooth Ky""-valued function u; such that 


(5.9) 
ftw I2Q)d%y S—— § Wmldeod¥ s <r? + lr) (5.10) 


By 59), the norm function |\u;\|2, for each i satisfies an elliptic equation 
A(\\4;llg(X)) = Diu; ]g,(x) — 2m ||; ||3,(x) + 2Re(h(u;, 0F0,v,))(x) (5.11) 
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where 6 ¥ is the adjoint operator of 0; on Ky"-valued function with respect to g;. 
As in (5.5), we also have 
sup {||0 ¥0 ;v;||2.(x)|xeM,\ Bar,(Xig, 9;)} 70 as i oo (5.12) 


Combining (5.9) and (5.10), we see that u; converge uniformly to zero in the sense of 
the remark after Lemma 5.1 as i goes to infinity. Put 


(v,(x) — u,(x)) : (5.13) 


( i) ll; — Ui; lax) dV, J 


Mi 


S'(x) = 





Then {S‘} is the required sequence. 


Lemma 5.3. Let {(M;,g;)} and (M,,,9,,) be given in Proposition 4.2. For each 
integer m > 0, we have othonormal bases {Sing }o < 6 < w,, (resp. {Smp}) of H°(M;, Ku”) 
(resp. H°(M,,, Ku™)). Then 


lim (in| ¥ Sky izco} ) > int > Sz i300) (5.14) 
p=0 


imo \ Mi Mo \p=0 


Proof. By direct computations, we have 
A;(\|DjSmg ll g.)(X) = ||D;D;Sing llg.(x) — (4m — 1)|| D;Sing ll gi) (5.15) 


where A; (resp. D;) is laplacian (resp. covariant derivative) with respect to g;. Then 
by (5.1), Lemma 2.1 and standard Moser’s iteration, there is a constant C’(m) 
depending only on m such that 


sup {||D,Sinpll2,(0)10 < B S Ny, xEM;} S$ C'(m). (5.16) 


Combining it with (5.2), we conclude that the first derivatives of )} o ||Sigll2,(x) 
are uniformly bounded independent of i. Then (5.14) follows from this and Lemma 
$.8, 32 

As a corollary of this lemma, we have the following weak partial C°-estimates 
of the solution of (1.1),. 


Theorem 5.1. There are a universal integer m, > 0 and a universal constant C > 0 
such that for any Kahler-Einstein surface (M’, g') in 3,(5 <n < 8), we have 


Nm 
int y isji3} >C>0 (5.17) 
M’ \p=0 


where N,, +1 is the complex dimension of H°(M’', Ky") and {Spho<psn is an 
orthonormal basis of H°(M’', Ky") with respect to the inner product induced by g’. 


Proof. It suffices to prove that for any sequence of Kahler-Einstein surface 
{(M;, g;)} converging to a Kahler-Einstein orbifold (M,,g,,) in the sense of 
Proposition 4.2, there are my > 0 and C > Osuch that (5.17) holds for these (M,, g;). 
By Lemma 5.3, it is sufficient to find a large m such that 


Nm 
int Y 1Sx, Penix} >0 (5.18) 
y=0 
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where {S*,}, N,, are given as in Lemma 5.3. It is equivalent to that for any point 
x in M, , there is a holomorphic global section S in H°(M,,, Ky™) such that 
S(x) + 0. The latter can be achieved by the application of L?-estimate (Proposition 
5.1) as follows. Let x1, ..., Xan be the singular points of M,,. There is a small 
positive number r independent of f such that for any xg in M,,, the closure of 
each connected component in B,(xo,, I. )\{X og} is locally uniformized by a neigh- 
borhood U,(1 s <j < |,) of the origin o in C? with finite uniformization group I. 
Let 14;:U 5; B,(Xao,9) be the natural projection with 1;(0)=x.,, and 
q=IJhisssw]isjsr,%j), where gg; is the order of the finite group I,;. Let 
m = pq. We will choose p later. We may take r to be sufficiently small such that the 
function pp = dist(-,x..;)? is smooth on B,(x.,9.)\{Xog} for any B. Now fix 
a Xp, and Us,. 

Let (z,,2z) be a coordinate system on U,,;, define an n-anticanonical section 


v by 
0 0 re 
v(y) = + o((= A =) Jon yeUs;. 


ely; 


By the definition of g, we have v(o) + 0. Let n:R' > R} be a cut-off function such 
4 
that y(t) = 1 for t < 1; n(t) = 0 for t = 2. |n’(t)| S 1. Then w = n( “EP Veale is 


a C®-global section of the line bundle Ky”. Choose a large p depending only on 
r such that for tangent vector v of type (1, 0), 


(20 (sn (“to e(2r)) + esa vA ) > IIvii20- (5.19) 


Applying Proposition 5.1, we obtain a C® smooth Ky, -valued function u satisfy- 
ing du = dw and 


J iul2ne~0e(%) a7. < fw iZne-0(%) dr < +00 . 


Mo 
It follows that the pull-back 7j;u of u vanishes up to order 3 at the origin in 
Us; < C?. Put 


so 
Spi = T (5.20) 


Zz 
( f \|w ve Hide se) 
Mo 


then S,;¢ H°(M,,, K%,,) and infg, {7}; ||Sp;\|g.0(x)} > 0. By the same arguments as 
in the proof of Lemma 5.3, one can bound the first derivatives of these S,; by 
a uniform constant. So if r is taken sufficiently small, we have 





Nm 
inf DY Si lgeo()|X€ B,(X0p1 Ja 1 SBS Na} 
y=0 


> inf {|Spjll2..(x)|xemg(Up;), 1S BSN» 1 Si <1,} 
0. 
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For any point x in M,,\(p=1B,(X0p,9.), define p, = dist(-, x)’. As above, 
applying Proposition 5.1 to Ky™-valued 0-equation with the weight function 


+ , : . 
sn( “= )tog( 2s :) one can easily construct a holomorphic section S, in 


H°(M.,, Km™) such that S,(x) +0. Thus the inequality (5.18) is proved. So is 
Theorem 5.1. 


Proposition 5.2. The Kahler-Einstein orbifold (M,,,, 9.) in Proposition 4.2 is locally 
irreducible, that is, for any r>0O and any point x in M,,, the punctured ball 
B,(x, g.,)\{x} is connected. In particular, the orbifold M ,, is irreducible. 


Proof. It suffices to check the local irreducibility at a singular point x, say x = x1, 
in M,,. Suppose that M ,, is not locally irreducible at x = x,,,, then we have open 
subsets OR: F hh (I, = 2) uniforming the closures of the connected compon- 
ents in B,(x, on )\ {x}. In the above proof of Theorem 5.1, we construct a S in 
H°(M,,, Ki,) for m=m, such that it can be decomposed into v+u in 
BE (x, 9.)\{X}- Both v, u are holomorphic in BE(X0sIa)\ {x,,,} and satisfy (1) 


v=0 on mG (i222), and — inf{\lo(y)lyer,(Gi1))20°>0; (2) 
\|u ll ga0( y) S Cdist(y, x,)* for a constant C. In particular, it implies that for any 


, 


; : c waar 
sufficient small r’ > 0, we have a uniform lower bound 5 of the oscillation, 


Cc 
Oy(S, Jo) = SUP{IIS Ilg.(Y) — ISllg. Il» Z€ OB, (X1,90)} 2 5 
By Lemma 5.2, there is a sequence {S'} with S' in H°(M;, Ky™) such that S' 
converge to S as M; converge to M ,. Then for any fixed small r’, 


Ul 


lim «,(S', g,) = 0,(S, 9.) 2 5 (5.21) 
On the other hand, in the proof of Lemma 5.3, we proved that there is a constant 
C(m) depending only on m, such that 


sup (|| Vi(\|S‘llg,) Ilo.) S C(m) . 

M; 
It follows that @,(S’,g;) < 2C(m)r’. It certainly contradicts to (5.21) when r’ is 
sufficiently small. So M,, is locally irreducible at x,,;, similarly at x,,;(2 <j </,). 
The proposition is proved. 


Remark. Let x;,¢M;,(1 S B S N) be given in (3.14), and B (Xig, g;) be the universal 
covering of the ball B,(xig, g;) in M;. Then, as Proposition 4.2, for r any fixed B, these 
Bxig; gi) converge to an open Kahler-Einstein orbifold B,(r). The above 
arguments also prove that this B, (r) is locally irreducible, in particular irreducible. 
As a consequence, it implies that oB (Xig, g;) is connected if r is small and the 
fundamental group 7, (B,(x;g, g;)) is a quotient group of 2,(0B,(x;g, g;)) by some 
normal subgroups. 

Now we come to study the singularities {x..g};<,<~ of the Kahler-Einstein 
orbifold (M ,,, g,,) in Proposition 4.2, where N is given as in Lemma 3.2. Precisely, 
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we want to make reduction of those local uniformization groups I, for 
{Xoop}is psn: 

Choose a small 7 > 0, such that for any B between 1 and N, the ball B;(x..5, 9...) 
is geodesically convex and is locally uniformized by an open subset U gin C? with 
the local uniformization group T" p: We identify I’, with the induced action of I’, 
on 7, Ci. where o is the preimage of xx, arenes the natural projection 
Ts :U p > B;(Xxg,9~). Then I’, can be considered as a finite subgroup in U(2). 
Let {r;} be a decreasing sequence with lim;.,,r; = 0, they by Proposition 4.2, 
there are diffeomorphisms ¢; from M; /3 =1 Bo,,(X0p. 9.) and (o; ')*g; converge 


pointwisely to g,, in C®-topology. We may assume that all r; < am 


Fix a singular point x = x, say # = 1 for simplicity, we define S,(i) to be 
$; ‘(0B,(x, g,,)) for 2r; < r < #. Then each S,(i) is isomorphic to a generalized lens 
space $3/[ with [ =I, and covers a domain B,(i) such that B,(i) converge to 
B,(x, g,,) aS i goes to infinity in the sense of Proposition 4.2. By taking 7 smaller, we 
may assume that each B,(i) is geodesically convex. As mentioned in the above 
remark, by the same proof as that for Theorem 5.1, one can prove that for any r > 0 
and i, the fundamental group 7, (B,(i)) is the quotient group of I’, by its normal 
subgroup. In particular, the group 7,(B,(i)) is a finite group with its order uni- 
formly bounded. We may assume that the orders of these 2,(B,(i)) are all same. 


Lemma 5.4. Let pr,:B;(i) > B;(i) be the universal covering and gj, = pr*g,. Then 
(B;(i), g ;) converge to an open Kahler-Einstein orbifold (B; (00), g) in the sense of 
Proposition 4.2. Moreover, there is a natural projection p,_, :B; (9..) > B;(x, 0) of 
order #7 ,(B;(i)) and g ,, = p*g,.. and B;(c0 ) has a rational double point as the only 
singular point. 


Proof. The convergence of {(B; (i), g ;)} follows from Proposition 4.2 and the 
definitions of B (i) and B (i). It is clear that B ;(0o) has only one singular point. So 
it suffices to prove that this singular point is a rational double point. By Theorem 
5.1, we have holomorphic sections S' in H°(M;, Ky™°) such that when r > 0 is 
sufficiently small, there is a positive number c > 0, 


O<cS|[S'|2(x) <1 for xeB,(i) (5.21) 


Then each pr*S' is a holomorphic m,-anticanonical section on B,(i). Since the 
preimage (p,,)~ ‘(B,(i)) is simply-connected, the m,-root of pS" exists as a holo- 
morphic anticanonical section on ((pr;)~ '(B,(i)), denoted by S$‘. Then 


O< ie < ||S'|2(x) <1 for xe(p,,)” *(B,@) (5.22) 


By (5.22), we may assume that S$‘ converge to a nonvanishing holomorphic 
anticanonical section S$ in (P,..)- (B, (x, g.,)). The local uniformization U, of x in 
M.,, is also the one for (p,_)~ 1(x) in B ;(0o), and we have the following commutative 
diagram, 
— B 7(00) 


\E 


B;(x, In) 
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Let I’ be the local uniformization group of ( Pr.) * (x) in B;(0o). Then #* § is 
a I’’-invariant holomorphic anticanonical section on 7; '(B,(x, g,,)) < U,. Since 
i § + 0, the induced action of I’ on A?(T,U ,) is trivial. This means that I’ is 
a finite group in SU(2) if we identify I’ with its induced group on 7,U , = C?. So 
the singular point Pr, (x) is a rational double point. The lemma is proved. 


Lemma 5.5. The induced group of I on T,U , = C? is either a finite subgroup in 
SU(2) or one of the following cyclic group Z,, p,q defined as follows, where p, q are 
coprime, let (z,, Z) be the euclidean coordinates in C, define 


G1, p.qiC? > C’, 





2n,/ —1 _ Sy) . ee! 
Ip? Pp 22 


ounalevs2a))=(¢ Ip? 2458 


then Z,, p,q is generated by 0;, p,q. 


Proof. Let ¢; be the diffeomorphisms given before Lemma 5.4. There is a decreas- 
ing sequence {¢;};>, with lim;.,, ¢; = 0 such that 


sup {bi *)* 9: — Geo lo. (Y) ID*(O7 *)*(Gd)llo.()} S & - (5.23) 


Isks5 
ye M\p=1 Br (X09) 


; Sens ; ] 
where D is the covariant derivative with respect to g,,. Put u; = —=. Then 


a 


sup {Di *HiGi) — HG co Nnjon(Y> WD(Pi *)* HiGi)Ilu9..0)} S & 


1sksN 
ye Br(x, 9..)\ Br,(x, 9.0) (5.24) 
where D, is the covariant derivative with respect to g,,. Since the curvature tensor 
R(g,,) of g,, is uniformly bounded on M ,,, the dilated manifolds (B;(x, 9,,), Hi9..) 
converge to the flat cone C?/I, with complete flat metric g,. So it follows from 
(5.23) that (B; (i), u;g;) converge to (C?/I’,, gr). Similarly, the Kahler-Einstein mani- 
folds (B;(i), u;pr*g;) converge to the cone (C?/I’, g,) with I’’ < SU(2). The funda- 
mental groups 7, (B;(i)) can be regarded as the finite isometry groups on B;,(i). 
Then the actions of these 7, (B;(i)) converge to the linear action of f = I',/I’ on 
C?/I’'. Note that I’ is a normal subgroup of I. 
It is classical result by Klein that C?/I’ is one of the following normal 
hypersrfaces in C* with euclidean coordinates (w,, w2, W3), 


A,-1(n = 2): w,w3 + wh = 0 or w3 + wi + wi = 0 
D,(n 2 4): w3 + w2(wi + wz") =0 
E<: wi + w? + we =0 
E,: w3 + w, (wi + w3) =0 


E,: w3 + w} + w3 =0 
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Claim 1. The finite group F has a faithful representation in SL(3, C) such that the 
action of [ on C?/I’ coincides with its restriction to the hypersurface correspond- 
ing to C?/I’. 

Although this claim should be the special case of a more general theorem, we 
give an elementary proof here. 

As before, let (z,, z,) be the euclidean coordinates of C?. Let C;-[z,,z,] be the 
algebra of all I’’-invariant polynomials in C[z,,z,]. Then the result of Klein 
actually says that C;-[z,,2z,] is generated by three homogeneous polynomials, i.e. 
induced ones by restriction to C/I’ of coordinates w,; on C*. We still denote them 
by w,, W2, w3. Since I’ is a normal subgroup of I, any oeI preserves the 
subaigebra C;-[z,, z, ] of the polynomial algebra C[z,, z, ]. Thus F has a holomor- 
phic action on C? with its restriction to C?/I’ equal to the original action of . We 
need to prove that this induced action o* on C? is linear. By the explicit forms of 
the defining polynomials in (5.25), one can easily prove that as polynomials of 
(21,22), 

deg(w,) S deg(w,) S deg(w,)deg(w,) < 2deg(w, ) (5.26) 


If deg(w,) = deg(w,), then o*w; is a linear combination of w,, w, and w; for any 
o él. Thus we may assume that deg(w,) > deg(w,). If deg(w, ) = deg(w,), then for 
any o€ IT, o*w; depends linearly on w,, w, for any i = 1, 2. On the other hand, o*w, 
can not contain w,, w, since o* preserves the defining equations in (5.25), so o* is 
linear. If deg(w, ) < deg(w,), then by the second inequality in (5.26), the polynomial 
o*(w,) does not depend on w, and o*(w;) does not depend on w, for i = 1, 2. Thus 
by the fact that o* preserves one of the equations in (5.25), one can easily see that 
o*(w,) = A4;w; for some constants A; (j = 1, 2, 3), in particular, the action of I is 
linear. The final case is that deg(w, ) = deg(w,), deg(w,) < deg(w,). In this case, the 
group I” is of type A,(n = 2), ie., the hypersurface C/I’ is defined by A,-type 
polynomials in (5.25). Then w, = zi, w, = 2,22, W3 = 23. By the I’’-invariance of 

w,, one can easily prove that o* is linear. The faithfulness can be easily proved. 
The claim is proved. 

Note that I’ is the subgroup of I consisting of all elements with determinant 
one, so [ =I°/I’’ is a cyclic group. Let o be one of its generators. By the above 
proof of Claim1, we actually proved that the induced action o* on C? is diagonal 
except that I’ is of type A,. But if I’ is of type A,, all w; have the same degree on 
(z,, Z,), so by a linear transformation of (w,, w,, w3), we may also assume that the 
action of I’ is a diagonal and the defining equation of C/I’ is of form given in 
(5.25). 


2n/-1 , 
Write o = ding (2) (2), e(2)) where (2) =e >: Consider the 
representation of I in S’e C* defined as follows: 
p:tel > det(t)eS' < C* 


where the determinant is taken with respect to (z,, z,). Then ker(p) = I’ and the 
induced representation of p on I'/I’ is faithful. We still denote it by p. We may 


that pat x 5: = ; : a . So uj= who ney 
cuineetinend ae. “Sat SE ute az, dz, "Naz, * dz, 
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(j = 1, 2, 3) are [-invariant holomorphic local sections of K;.7}. on C?/I"’. 

Let ¢; be the diffeomorphisms as those at the beginning of this proof. Put 
py) = p.° 0;(y), where p,, is the square of the standard distance function on C?. 
Then for i sufficiently large, the function p; is plurisubharmonic on B, /,(i)/B,,(i), 
and these p; converge to p,,. 

As in the proof of Lemma 5.3, we let 0 ; be the d-operator associated to M; and 
nm; be the projection from @”(A?(TM; ® TM,)) onto Ky”. Define 


v= a(n (2 aor : 1(u)) 


where y is a cut-off function on R! with n(t) = 0 for t < 1 and n(t) = 1 for t > 1, 
\n’(t)| < 1. Let W be an increasing function on ( — 00, 4) such that W(t) = O fort < 1 
and w(t) goes to + 00 very fast as t > 4. As in the proof of Lemma 5.3, we apply 
L?-estimate of d-operators with weight function wo; (Proposition 5.1) to the 
equations 0;u = v,; on $; * (Br /z(Xo1+9.)) U Bayi) and obtain local holomorphic 
anticanonical sections u;; on (B /;(i), 4,9;) i = 1, 2, 3) such that u;; converge to u; as 
(Byrd, ug;) converge to ({p, <1},gp)<(C7/I,g,). Recall that 
pr;:B B (i) —B 3 ii (i) are universal coverings and there are nonvanishing holomor- 
phic sections S‘ of Kf 4) (cf. the proof of Lemma 5.4). Without losing generality, we 


0 0 
may assume that S‘ converge to — A oy on C?/I"' as i goes to infinity. Thus the 
1 2 


holomorphic functions w,; = pr*(u;;)/(S‘)) on (B Vali), Hig) Converge to w,; on 
ey". 

Claim 2. For any sufficiently large i, the functions {w;;}; <;<3 give an embedding ¥; 
of B Jr (i) into C? satisfying: 


(1) A generator o in 2,(B;(i)) can be taken such that it acts on C? by a diagonal 


matrix o*(w;;) = e A w;;- Note that 7, (B;(i)) is a cyclic group. 


(2) y(B /rAi)) converge to the open subset {p,, < 1} in C ?/T in Hausdorff topol- 
ogy. 

The map Y; is defined by assigning y in B (i) to (wi: (y), Wi2(y), Wis(y)) in C?. 
Since {(@; ')* Wij}isis3 converge uniformly to {w,}:<;<30n {¢ Sp, < 1} for any 
é > 0, the -~ Y; is an embedding on B Jili/B . ald for the sufficiently large i. 
Because K 4 m: is ample and there is a section in H°(M;, Ky”) vanishing nowhere in 
B /,(i) for a large m (Theorem 5.1), there is no complete holomorphic curve in 
B Jr (i). It follows that ¥; fails to be injective at most at finitely many points in 
B Jr (i). If Y; is not injective, then there are two points y,, y, in B J, (i) such that 
¥(y,) = P(y2). Choose a very small r>0, such that the geodesic balls 
B,(y;, pr*, g;) do not intersect to each other and ¥; is an embedding at any point of 
these balls except y,, y,. Let f; be the local defining function of Im(¥;) at ¥;(y,). 
Then f; is reducible. Let f/ (resp. f;’) be the irreducible component of f; such that 
{fi = 0} (resp. { fi” = 0}) corresponds to ¥,(B,(y,, pr*g;)) (resp. ¥;(B,(y2, pr*g;))). 
Then { f { fi = 0} (resp. { f;” = 0}) is smooth outside ¥;,(y, ) (resp. ¥;(y,)). Let D be the 
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curve defined by f; = 0 and f;’ = 0. Then Y, fails to be injective along ¥; '(D). 
A contradiction. Therefore, ¥; is an embedding from B Jr (i) into C 4 

In order to prove the statement (1), it suffices to check that for any r in 7, (B;(i)), 
we have r*(w;;) = A;;w;; for some real numbers 4;;(1 <j < 3). By definition, we can 
write w;; = pr¥*(u;;)/(S. ;)”’. Since each pr*¥(u;;) is [-invariant, we have 

* i \ Pj 
(r*S *)Ps Ts" 

where 4;; are holomorphic functions on B (i). Because t is an isometric of the 
metric pr*g, and S$‘ is the my-root of a I’-invariant mo-anticanonical section, the 
absolute values of /;; are identically one, so /,; are constants. 

The statement (2) is then trivially true. The claim is proved. 

Now we can complete the proof of this lemma. We identify each 2, (B;(i)) with 


T/T’ such that o = cing(e(2) (2), e(2)) as a linear transformation on C°. 
p Pp 


Let f,, f,, be the defining equations of ¥,(B /r(i)) and C/I in C°, respectively. Then 
f,. 1s one of the polynomials in (5.25) and lim;.,,f; =f,,. Since o preserves the 
hypersurfaces { f; = 0} and { f,, = 0}, we have that o*f; = if, o*f,, = Hf,,, where 
4 is a nonzero constant. If A + 1, then any f; has no constant term, in particular, the 
origin of C? is in { f, = 0}. It follows that the group ,(B;(i)) = I’,/I’’ does not act 
on B (i) freely. A contradiction. So 4 = 1 and each f, must have nonzero constant 
term. It follows that { f; = 9, w, = 0} is non empty for any i2 1 and 1 <j < 3. We 
remark that 7,(B;(i)) acts on { f; = 0} freely, so if kp; = 0 for (mod p) for some j’, 
then kp; = 0 (mod p) for all j, where k is an integer. Thus we may assume that 
0 < p; < p for all j = 1, 2, 3. If I’ is of type other than A,, then 2p, = 0 (mod p), so 
by the above remark, we have 2p;=p for all j. It follows that 
o = diag( — 1, — 1, — 1). It is certainly impossible since the latter diagonal matrix 
does not preserve the equation of type D,, E,, E,, E, in (5.25). Therefore, ’’ must 
be of type A,,. 

If the defining polynomial f,, is of form w3 + w]7 + w3 = 0, then the same 
argument as above shows that o = diag({ — 1, — 1, — 1). 

Now we assume that f,, is of form w,w, + w3 = 0. 


Claim 3. The element o in 7, (B;(i)) is one of o;,,,,, described in the statement of this 
lemma. In particular, the lemma follows from this claim. 

By the fact that the action of z, (B;(i)) is free of fixed point, we may assume that 
p,=1 and p,p, are coprime. Then n=pn’ by o*f,, =f,. Recall that 
W, = Z1, W3 = 23, W2 = 2,2, for euclidean coordinates (z,, z,) in C?. As an element 
od = Pl + rs) Let m be the largest 

n np p 
common factor of 1 + pq, and np, then m, p are coprime. Write 1 + pq, = ml,, 
np = n'p? = mip’, where I, is coprime to both / and p. Let m,, m, be such that 





in U(2), we can write o = cing( 


, 1 } : 
m,l, + m,lp? = 1 and m, is coprime to I, p. So o™ = ding( 7 y + a) 
Thus we may assume that o = o;,,,,. The claim is proved, and so is the lemma. 
We summarize the above discussion in the following 
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Theorem 5.2. Let {(M;,g;)} be a sequence of Kahler-Einstein surfaces in 3, with 


Ric(g;) = @,,. Then by taking a subsequence if necessary, we may have that (M,g;) 

converge to an irreducible Kahler-Einstein orbifold (M ,,, 9,.) (in the sense of Proposi- 

tion 4.2) satisfying 

m(m + 1) 
2 

(2) M,, has finitely many isolated singularities. Each of these singularities is either 
a rational double point (cf. [BPV], p87) or a singular point of type C?/Z,, p,q with 


(1) For all integers m > 0, h°(M,,, Ku) = h°(M;, Ku) = 1 + (9 — n). 


48 
a cyclic group Z;, p,q defined in Lemma 5.5. Moreover, Ip? < cy The latter 


singular point is a Hirzebruch-Jung singularity (cf. [BPV], p80). 


Proof. By Proposition 4.2, Lemma 5.2 and Lemma 5.5, it suffices to prove the 
upper bound of Ip? required in the above (2). 
By Bonnet-Myers Theorem ([(CE]), we have 


diameter of (M;, g;) S ./3z for all i (5.27) 
It follows 
diameter of (M,,,9.,) S ./31. (5.28) 


For any fixed i and x;¢ M;, by Bishop’s Volume Comparison Theorem [Bi], we 
have 


Vol,,(B,(x;,9:)) _ Vol,,(M;) 
9VOI(Br (0,gs-)) 2 VOUS") 
Ri 





for r small (5.29) 


where (S*, g,) is the sphere with standard metric gss, and o is the north pole in S*. 
Taking x; in M; such that lim;..,, x; = x, is a singular point of type C?/Z,, p,q; 
then it follows from (5.29) that 


A ee tae 
Ip? ~ 18Vol(S*) 48 
48 


< "aes " 





Ip? 


The theorem is proved. 


Remark. 

(i) In case n = 5, there are three possible (I, p, q) for Z;,,,, in Theorem 5.1, i.e., 
(l, p, q) = (A, 2, 1), (2, 2, 1), (1, 3, 1). Note that Z,1,3,1) = Zi, 3, 2)- 

(ii) In case n = 6, there are four possibilities: (I, p, qg) = (1, 2, 1), (2, 2, 1), (3, 2, 1), 
(1, 3, 1). 

(ii) In case n = 7, the triple (I, p,q) could be (i, 2, 1) for 1 <1 <5, (I, 3, 1) for 
1 <1 <2 and (1, 4, 1). 

(iv) In case n = 8, the triple (I, p,q) could be (I, 2,1) for 1 </ < 11, (I, 3, 1) for 
1</S5,(l, 4, 1) for 1 <1 <2, (1, 5, 1), (1, 5, 2), and (1, 6, 1). 
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6. Anticanonical divisors on some Kahler-Einstein orbifolds 


We still denote by (M,,, 9,,) the irreducible Kahler-Einstein orbifold in Proposi- 
tion 4.2. Then this M ,, is a normal surface with finitely many singular points. Each 
of these singularities is either a rational double point or a Hirzebruch-Jung 
singularity (cf. [BPV]). The purpose of this section is to study the plurianticanoni- 
cal divisors on M,,. Although the results here should hold in more general 
situation, we will confine our discussions to our special case. 


Lemma 6.1. (Poincaré Duality Formula) Let (M,,,9,,) be as above and w,_ be the 
Kahler form associated to the metric g,,. Then 


(1) For any pluri-anti-canonical section Se H°(M,,, Ku™), we have 


Jf @2,=mj o7, =9-—n)m (6.1) 


{Ss =0} M 


o 


(2) Let D be a divisor in M,,, Se H°(M,,, Ku™) and Dg is the divisor defined by the 
section S such that D and D, have no common component, then 


1 
m\o, = ———~i, (x3 D, xED 6.2 
} r &, deg(r,)” s) _ 
where 1,:U,-+M,, is a local uniformization of x with x,(0)=x and 
i,(x% D, x¥D,) is the intersection multiplicity of n$D and n*D, at the origin (ef. 
[BPV]). Note that x is smooth iff deg(x,) = 1. 


Proof. The proof is standard. For example, in the case (1), 


| gee ae 
m jo; =lim f a, A (mo, + 00 log(e + S13) : 


2n 


One can easily check that the right-handed side is just {;s _ 9, @,,. The case (2) can 
be similarly proved. 

Let 2:M ,, > M,, be the minimal resolution. Then for each singular point x in 
M.,,, the exceptional curve 2~'(x) is either an A — D—E curve or a Hizeb- 
ruch-Jung string according to whether x is a rational double point or not (cf. 
[BPV]). In particular, any singular point is rational. It is easy to show that 
h°(M ., Kia™) = h°(M.,, Ky) for any m. For any integer m > 0, 


Ka" = B,, + D,, Ku™ = B, + Dy (6.3) 


My e70M, 


where B,,(resp. B,,) consists of all one dimensional components in the base locus of 
Kq™(resp. Ky™). Then 2(B,,) = B,,, ™(D,,) = D,,. We denote by |D,,| the linear 
system of the divisor D gp CC. 

We will first prove that the generic divisor in ID, | is irreducible. If n = 8, then 
dim|D,| = h°(M,,, D,) — 1 = 1, it follows that the generic divisor in |D,| is irredu- 
cible. 


Lemma 6.2. Let n = 5, 6, 7. Then if the generic divisor in ID ,| is reducible, we can 
write D, = (9 — n)E with E? = 0 and h°(M ,, E) =2. 
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Proof. Wecan write D, = oY _ , %,E; such that E; is not linearly equivalent to E, for 
i+/j, any |E,| is free of one dimensional component in its base locus and the 
addition map: | ]/-1|E;|"‘> ID, | is generically surjective. We need to prove that 
| = 1. Suppose that / = 2. We may assume that E, can not be decomposed into the 
sum of E, and an effective divisor. We remark that the addition map: 
|E,| x |E,| > |E, + E,| is also generically surjective. Choose an irreducible divisor 
in |E,|, say E, for simplicity. Then for any point x in E, outside the base locus of 
|E, + E,|, we have a divisor in |E,| intersecting E, at x. Thus 
E,:E, 21+ # {base points of |E, + E,|} (count multiplicity). By Bertini’s the- 
orem (cf. [GH]), the generic divisor E in|E, + E,| is smooth outside the base locus 
of |E, + E,|. So E can not be written as the sum of divisors in |E,| and |E,|. 
A contradiction. Thus / = 1, D, = aE (« = 2). The above arguments also show that 
h°(M ,,, E) = 2. Since h°(M,,, D,) = 10 — nand the generic divisor in ID ,| can be 
written as the sum of « divisor in |E|, we must have «=9-—n. Then by 
Riemann-Roch Theorem [GH], 10 —n2=1+«?E*, so E?=0. The lemma is 
proved. 

Denote by I P(I, p, 1) be the germ of all holomorphic functions f at the origin of 


1 ; 
C? such that of ,,..f =e : |f One can easily compute 


pl—2 
P(l, p, 1) = {feC?{z,,z,}|f= > (45 y Hf (ch*, z2) ) (6.4) 
k=0 


fj‘ are homogeneous polynomials of degree j, + jp7/} 


where jo=(p—I)pl, jess =i, +(pl+1) (modp?l) and 0<j, <p?! for 
O<skspl—-2. 

The meena of IP(I, p, 1) in our context is the following. If x is a singularity 
in M,, of type C*/Zi, 9.15 Mt 2, :U,+U, ¢ M,, be a local uniformization, where 
U, <C2,U (0) = x, then the local holomorphic sections of Ky,’ in U, correspond 
to one-to-one the functions in J P(I, p, 1). 

We list some simple lemmas in the following. 


Lemma 6.3. Let IP(I, p, 1) be defined as in (6.4). Then 
(1) The monomials in IP(I,2,1) of degree <2I are 2z}',z3',z,z,,2}23,..., 
I—1 
zzktlz2k+l where k = >| 
: : 91 
2) If |=1, 2, then the monomials in IP(l,3,1) of degree < 5 are among 
2}, 242252123. 
(3) The monomials in IP(1, 4, 1) of degree <8 are z,2,, 23, 2723. 
In particular, if p?1 < 24, then for each (A, 1) being either (4, 0), or (0, 4) or A = 2, 
2 


pt = 2, there are at most two monomials in IP(I, p, 1) with degree < = and contain- 
ing the factor z}z4. 


This follows directly from (6.4) and some simple computations. 
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Lemma 6.4. Let f, g be holomorphic functions at o€C? and have no common 
component. We further assume that of ,,, f = cf and { f = 0} is smooth at 0. Then we 
have 


{f= 0}, tg =O} 2 


inf{A(p? — pl + 1) + w\zjz4 is in g}, if f=z, + O(|z|”) 
inf{A + u(pl — 1)|z4z4 is in g}, if f =z, + O((z|?) 
where i,(-,-) is the intersection multiplicity (cf. [BPV]) and |z|* = |z,|* + |z,|?. 


(4.13) 


Proof. We assume that f = z, + O(|z|”). The proof for the other case is same. Write 
f= 721f,(2;, 22) +f,(z,), then f, (0, 0) + 0 and ord,(f,) 2 2. By the assumption that 
of p:f=of, we have_ord,(f,)2 p?!—pl+1. Put_w, =2,f;(2,, 22) + (22), 
W> = 2, then z, = wif ,(w,, W2) +f(w>) with ord,(f,) = p21 — pl + 1. Now by 
the definition of the intersection multiplicity, we have 


ig { f = 0}, {g = 0}) = ord, (g|;r-0;) = ord,(g( f2(w2), W2)) - 


Then lemma is proved. 
We now come to apply these two lemmas to studying the properties the 
anticanonical divisors on M,,. 


Lemma 6.5. Let D , be defined as in (6.3). Then the generic divisor in the linear system 
|D,| is irreducible unless n = 7, B, = @ and M.,, has exactly two singular points of 
type C7/Z;,2,1. 


Proof. By some results in [De], we may assume that n < 7 and M , has at least one 
singular point besides rational double points. Let x,,..., x, (J 2 1) be those 
singular points in M,, other than rational double points, and F,,..., F, be the 
exceptional curves in the minimal resolution M ,, over X,,..., X.. Suppose that 
the generic divisor in |D,| is reducible. By Lemma 6.2, we write D, = (9 — n)E. 
Claim 1. The divisor E must intersect one of F;, say F, for simplicity. Moreover, 
E-F, =1. 

If E- F, = 0 for any j, let H be a divisor of Ky,” for some m > 0 such that x;¢ H 
(j=1,2,..., 0). Then H-2(E) = Ky”: E 2m. By Lemma 6.1 (1), we have 


9-n=fa,+9-n) f o,, 
B, n(E) 


(9 — n)H-n(E) 
Ties 


=fo,+ 
B 


Therefore, B, = @. It follows that all x, are rational double points. A contradic- 
tion. So we may assume that E-F, = 1. Let F,, be the component in F, with 
F,,:E = 1. Incase that 9 — n = 3 or there is another component in B, intersecting 
F,, at some pom, the divisor F,, has multiplicity two in B, by 
— Ky,° Fy, = Fj, + 2. It follows that E-F,, + E- F,<B, -Es2,i¢e.E-F, = 1. 

Thus we may assume that x, is of type C?/Z;.2,, and F, ‘(B, —F,)= 0. By 
adjunction formula, we have — 2 = Kg'-F, 2 F7?+2F,-E=-—4+ aF, -E, 1.e., 

F,:E = 1. The claim is proved. 





148 G. Tian 


Claim 2. If x, is of type C?/Z,,2,,, thenn = 7, B, = @ and M,, has exactly two 
singular points of type C?/Z, >. 

We first prove that E must intersect another exceptional curve F, other than F;. 
In fact, if it is not true, then F, has multiplicity two in B,. By — Ky_-F, = F i + 2, 
there are exactly six curves in a generic anticanonical divisor on M ,, intersecting 
F,. Thus for any S in H°(M,,, Ky’), the pull-back z¥S is locally represented by 
a holomorphic function f, in JP(1, 2, 1) with vanishing order at least 6 at 0, where 
m,:U, + U, is the local uniformization of x, in M,,. By (6.2) in Lemma 6.1, if 
{S = 0} has no common component with 2(E), we have 

9-n=fo, +9 -n) f 0,222" 

B, n(E) 


mult,({S = 0}) > 50 am. 


A contradiction. Therefore, the divisor E intersects with another exceptional curve, 
say F,. Then n = 7 and F,-E = 1, so by Kq'- F, = F3 + 2, the singular point x, 
must be of type C?/Z, >,,. As above, by using Lemma 6.1, one can prove that 
B, = @. Thus there is no other singular point in M,, besides rational double 
points. Claim 2 is proved. 

Now we may assume that x, is not of type C?/Z, > ,, then F, has multiplicity 
two in B, and E intersects with no other F(j 2 2). By (6.2) in Lemma 6.1, we have 


fo,<1 and <1ifB, +O. (6.5) 
n(E) 
Let z,:U, + U, be the local uniformization of x, with uniformization group I as 
then as above, the section S in H°(M,,, Ky’) is locally represented by a f, in 
IP(I, p, 1), where x, is of type C?/Z,, 1. It follows from (6.5) and Lemma 6.1, 


i,({fs = 0}, mi *(n(E))) Sp? and <p*lif B, + (6.6) 
where i,(-,-) is the intersection multiplicity at the origin in U,. 


Claim 3. For generic E in the linear system |E|, the pull-back 2; '((E)) is smooth 
at the origin. 

Let (z,,z,) be the local coordinates of U, such that the generator oj, pi Of 
I’, = Z,,p,1 is diagonal in (z,, z,). Also let h, be the defining function of x; '((E)) 
in U,, then of ,, ,hg = ch, for some constant c. First we prove that ord, (hg) < 2 for 
generic E. If this is not true, then ord,(f,) 2 6 for any section S in H°(M,,, Ky’). 


By Lemma 6.3 and the fact that h°(M ,,, Ky*) 2 3, one can easily find a section S in 
2 


’ ; l 
H°(M.,, Ky’), the local representation f, vanishes at o of order > “ for those 


(l, p, 1) with p?] < 24. Now we choose a generic E such that E has no common 
component with {S = 0}, then we have 


i,({f, = 0}, mz *(n(E))) 2 ord, (hg): ord,( fs) > pl. 


It contradicts to (6.6). So ord,(h,;) < 2. Using the invariance of ,, ;h, = ch, and the 
fact that o,,; has distinct eigenvalues, we conclude that 
h,(z,, 22) = z} + O(|z\***) or zz, + O(|z|*), where A = 1, 2. In the former case, if 
A = 2, then for any S in H°(M ,, Ki’), the lowest order term of f, has the fact z7, so 
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2] 
by Lemma 5.3 again, we can find such a S that ord,( f,) > . As above, we can 


deduce a contradiction to (6.6). Some arguments exclude the possibility of 
hg = 2,2, + O(|z|*). Therefore 4 = 1 and the claim is proved. 

We now want to apply the formula in Lemma 6.4 to our cases and conclude the 
proof of this lemma. It suffices to find a S in H°(M,,, Ky’) such that for any term 
zjz4 in fy, either A(p?] — pl + 1) + uw > p?l for j = 1, where h, = z, + O(|z|?), or 
A+ u(pl — 1)> p?l for j = 2, where hz = z, + O(|z|”). Since there is only one 
monomial z?z4 in IP(I, p, 1) such that A + pw < pl and 4 < 1, we may find a S in 
H°(M.,, Ky’) such that any term z{z4 in f, has either 2 + y > p?! or A = 2. So by 
the fact that 2(p?/ — pl + 1) > p?/ for p = 2, we may assume that h, = z, + O(|z|”). 
By (6.4), any monomial z+z4 in JP(I,p,1) can be written z4*''~-!4'24 with 
4+ pw=j,, thus : : 

A+ u(pl — 1)=k + (pl — 1)j, . 
One can easily check that for those (I, p, 1) with p*! < 24, the monomials z,z,, 
zR' are only ones in IP(I, p,1) with 4+ (pl — 1) < pl. Then by the fact that 
h°(M ., Ky) 2 3, we may find a S in H°(M,,, Ky’) such that f, does not contain 
Z,Z, and z'. It follows from Lemma 6.4, 


ig({hz = 0}, { f5 = 0}) > p?l (6.7) 
Therefore, we obtain a contradiction from (6.6) and (6.7). The lemma is proved. 


Proposition 6.1. Let {(M;, 9;)},(M... 9..) be given as in Proposition 4.2. Assume that 
n= 7. Then M.,, has only rational double points as singular points unless M ,, has 
exactly two singular points of type C?/Z,,2,,, and |Ky'| is free of one dimensional 
components in its base locus. Moreover, the linear system |K | is always free of base 
point. 


Proof. It is well-known that each M, is branched double covering of CP?, in 
particular, each M; admits a nontrivial involution 1; (cf. [De]). One can easily 
check that the fixed point set A; of t; is a connected smooth divisor in |2K | and 1; 
preserves any anticanonical divisor. These t; converge to a nontrivial involution T,, 
of M ,, as M; converge to M,, in the sense of Proposition 4.2. The fixed point set A ,, 
of t,, is the limit of A; and then is 2-anticanonical divisor in |2Ky'|. 

Let 2:M,, > M,, be the minimal resolution as above and B,, D,, B,, D; 
defined as in (6.3). We first assume that the generic divisor in |D,| is irreducible. 
Choose such an irreducible one, say D, for simplicity. Fix a regular point x of M,, 
in D,\(A,, U B,). Since h°(M,, Ky’) = 3, we can find another divisor D‘, in |D,| 
such that D, and D{, have no common component and xe D, 7D. Since both D, 
and D‘, are stabilized by t,,, their intersection D, 7 D‘, also contains t,,(x). By 
Lemma 6.1, we have 


2= j Wy, + j Wy, 
B, Di 


2Ja,+ 2 


i,(x* D,, n¥D,) + i,(D,, Di) + i-¢9 (D1, D1) 
B yeSingm,) deg(,) lite ie abt ry 
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where 7, : U, — U, is the local uniformization of y in the singular set Sing(M ,,). It 
follows that B, = @ and none of singular points in M ,, is in the base locus of 
|Ky'|. The latter implies that all singular points of M,, are rational double points 
(cf. [BPV]). 

It remains to conside the case that the generic divisor in |D,| is reducible. Then 
by Lemma 6.5, it suffices to prove that the base locus of |2Ky*| does not contain 
those points of type C?/Z,,,,. Now we have a natural divisor A,, in |2Ky’|. It is 
smooth and irreducible since it is the fixed point set of t,, and t,, is an isometry of 
(M..,9.,). We claim that A, does not contain an singular point of type C?/Z,, 2,1. 
In fact, if the claim is not true, both singular points p,, p, of type C7/Z,, 2, ; are in 
A,,,. By our assumption on |D, |, we can write D, = 2E and the generic divisor in |E| 
is an irreducible rational curve passing through p,, p,. On the other hand, since t,, 
preserves |D,|, it also preserves |E|. Choose a generic divisor in |E|, say E for 
simplicity, such that E intersects with A,, at a point outside p,, p,. Note that two 
generic divisors in |E| do not intersect to each other outside p,, P,. Thus t,, must 
stabilize E, then it fixes E since it fixes three points on E and E is rational. It follows 
that t,, fixes the generic points in M,, ie, t,, is an identity. A contradiction! 
Therefore, p,, p,¢A,, and |2Ky,'| is free of base point. The proposition is proved. 


Remark. One can also construct local nonvanishing sections of 2Ky' at the above 
P,, Pz and then use L?-estimate of d-operators (Proposition 5.1) with weight 
function alog(}7} =o |S? |2,.) to produce a section of |2Ky,*| which is nonzero at 
P;, P2, where {Sj }y< <2 is an orthonormal basis of H°(M,,, Km’) with respect to 
the inner product induced by g,,. In particular, it implies that |2K’| is free of base 
point. 


Proposition 6.2. Let {(M;,g;)} and (M.,,, g.,) be as in Proposition 4.2. Assume that 
n = 8. Then M.,,, has at most one singular point of type C?/Z,, 2, ;(2 < 1 < 7) besides 
rational double points. Moreover, the linear system |2K;'| is free of base point. 


Proof. It is known (cf. [De]) that each M; is a branched double covering over 
a quadratic cone in CP. It implies that each M, admits a nontrivial involution r,. 
Also, this t; preserves both anticanonical divisors and 2-anticanonical divisors. 
These t; converge to a nontrivial involution t,, of M,, as M; converge to M,, in the 
sense of Proposition 4.2. 

Let M,,, be minimal resolution of M,, and B,,, D,,, B,,, D,, be defined as in (6.3). 
The involution t,, can be lifted to M a» Still denoted by t,, for simplicity (cf. [La]). 
Then t,, stabilizes B,,, D,,, B,,, Dm, (m = 1, 2), respectively. We assume that M,, has 
a singular point other than rational double points. 


Claim 1. D*, = 0 

__ By Riemann-Roch Theorem and the fact that h°(M ,,, D,) = 2, we have either 
D*, =0 or D4’ =1 and B,-D, =0. If D{ =1, then there are two irreducible 
divisors D’,, D’, in ID, | such that D’, intersects D", at a point outside B,. By 
Lemma 6.1, 


l=fo,+fo,2jfo,+1 
B, D, B, 
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It follows that B, = @. Thus all singular points are rational double points. 
A contradiction. The claim is proved. 

The same arguments also prove that D, does not intersect B, outside singular 
points. Now r |D,| induces a fibration 7: ae —CP!. We claiin that the generic 
divisor in |D,| has a horizontal component. In fact, if it_is not true, then by 
h°(M,,,D,)=4, we have D,=3D,. It follows that D, + B, =2B,. Since 
| 3B, the divisor 2B, — B, is effective. By Dj = 0, we comchade that 2B, ~ B, 
is vertical with respect to the fibration 7: :M,, > CP’. It is easy to prove that 
2B, — B, is connected since D, is. Let E be the reduced divisor supporting 
2B, — B,, then E is a proper subset of one fiber in M,, and 
2B, — B, — E=D, — E. Since 2B, — B, — E and D, — E have no cominon irre- 
pee component, it follows that ‘(O, — EY =0. On the other hand, the divisor 
D, — E is a proper subset of a fiber, then (D, — E)? < 0. We get a contradiction. 
Therefore, the claim is proved. 

Now choose a generic D, in |D,| such that the generic divisor in |D, | intersects 
D, at at least one point outside B,. Since t,, preserves divisors in |D,| and |D,|, we 
have that n(D,) intersects the generic divisor in |D,| at at least two smooth points 
in M,,. By Lemma 6.1, we can conclude that B, = @ and n(D,) does not pass 
through the singularities of M,, other than rational double points. Then there are 
at most two singular points of type C?/Z,, >, , in M,, besides rational double points. 
By adjunction formula, one can easily prove that there is at most one singular point 
in M ,, besides rational double points. The above arguments also show that |2K 7 | 
is free of base point. 


Corollary 6.1. Let n = 7 or 8. There are constants c(n, k) depending only on n, k 2 1 
such that for any Kahler-Einstein surface (M’, g’) in 3,,, we have 


Nm 
int YS, 13} > c(n, k) (6.8) 
B=0 


M’ 


where m = 2k, N,, + 1 = dim,H®(M’, Ky”) and {S%}o < g <n, is an orthonormal basis 
of H®(M’, Ky") with respect to the inner product induced by g’. 


Proof. It follows from Lemma 5.3, Propositions 6.1 and 6.2 (cf. the proof of 
Theorem 5.1). 


7. Completion of the proof for strong partial C°-estimate 


In this section, we will complete the proof of Theorem 2.2, i.e., the strong partial 
C°-estimate stated in section 2. By Corollary 6.1, Lemma 5.3 and the arguments in 
the proof of Theorem 5.1, Theorem 2.2 will follows from the following proposition. 


Proposition 7.1. Let n = 5 or 6, and (M,,,g,,) be the irreducible Kahler-Einstein 
orbifold in Proposition 4.2 or Theorem 5.1. Then the linear system \6K y,' | is free of the 
base point. 


The rest of this section is devoted to the proof of this proposition. The basic 
tools are still the Poincaré duality formula (Lemma 6.1) and adjunction formula we 
have used in last section. 
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We fix the Kahler-Einstein orbifold (M,,,9,.) aS in Proposition 7.1 with 
C,(M,,)? = 9 —n, where n = 5 or 6. Let x: M,, — M,, be the minimal resolution 
ond X1,...+, X, be the singular points of M,, besides “rational double points. The 
corresponding exceptional divisors in M ,, are denoted by F,,..., F,. Define D,,, 
B,,, D »» B» as in (6.3). If M,, has only rational double points as singular points, 
then by the results in [De], the linear system |Ky’| is free of base point. So we 
suppose that k = 1. As in the proof of Proposition 6.1, etc, we may assume that F, 
intersects D,. We collect some simple facts either built up before or that can be 
easily proved by using Riemann-Roch Theorem and adjunction formula (cf. 
[BPV], [GH)). 

(F1) The generic divisor in |D,| is a smooth rational curve and D7 =8—n, 
Ky): D, = Di +2. 

(F2) For 8—n generic distinct points { Yihig jss—n in M, outside exceptional 
curves, there is a pencil of divisors in ID, |, denoted by \(D,, { yy} <jss-n)l 
such that the generic divisor in this pencil is a smooth rational curve and 
\(D,. {yj}1<j<s-n)| is free of base point outside {y,};<j<s-n- 

Let E be an exceptional, irreducible curve, ie. E? < 0, then if E ¢ B, and 
B,-E> 0, then E is of first kind, ie. E7 = — 1. Moreover, this E intersects 
cneate one irreducible component in B,. 

Each singular point x,(1 <j < k) is of type either C?/Zi,2,.1(1 $1 < 3) or 
C?/Z,.3,1- Thus the corresponding exceptional curve F ; is reduced and can 
be written as Fj, + ... + Fy, such that Fj Fj = 1 if |i—i’|]=1; =0 if 
ji—i’'|>1landF i is irreducible for each i between 1 and k,, where k; = 1, 2, 3. 
If k; = 1, then Fj, = — 4 and x; is of type C7/Z,, 2.1. If k; = 2, then either 
Fi : = Fha =—3or Fh = — 2, Fj, = —5 according to that x, is of type 
either C?/Z>,2,; or C?/Z;,3,1. If k; = 3, then x, is of type C?/Z3,>,,, and 
F}, = F}, = — 3, FR = -2. 

By these facts, there are three cases of M,, as follows. 


Case 1. F,-D, = 2, F,-D, = 0 for j 2 2. 


Case 2. F,-D, =1, F; D, =0 for j= 2, so the irreducible component in F, 
intersecting D, has soultiplicity two in B,. 


Case 3. F,-D, =1 and F,-D, = 1, F;-D, = 0 for j = 3. 
We will treat these cases separately in the following lemmas. 


Lemma 7.1. Let(M, 9), Fj , D, , etc. be given as in Proposition 7.1 and F,-D, = 2, 
F; D, = 0 for j = 2. Then B, = @, B, = F, and D, intersects with F,, and Fj,, at 
one point, respectively. Moreover, the Sit system 6K m_| is free of base point. 


Proof. Let a; be the multiplicity of the irreducible component Fj; (1 S$ i S$ k,) in 
B,, then by adjunction formula and (F1), we have 


z = B,-D, = a;F 1;°D, + (B, oa F,;):D, 
D,: Fy + (By — Fu) Fai = 2 (7.1) 


It follows from (7.1) and F,-D, = 2 that D,- F,; < 1 unless k, = 1, ie., x, is of type 
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C?/Zi.2.1, and D,:F,,;=1 iff (B,—F,,)°Fi;=1 and «,=1. Therefore 
D ,-F,;= 1 fori =1,k, and(B, — F,)-F, = 0,ie., x, ¢B,. By Lemma 6.1 and the 
above (F2), the generic divisor D, does not intersect B, outside x,,..., x,. On the 
other hand, since (M ,,, g,,) is a limit of some sequence of Kahler-Einstein surfaces 
according to Proposition 4.2, any anticanonical divisor in |Ky;'| must be connec- 
ted, so D, 1 B, contains some x; for j 2 2 if B, + @. By our assumption, we have 
x,¢D, for j 2 2. It implies that B, = @ and B, = F,. 

It remains to prove that |6Ky'| is free of base point. By Lemma 6.1 and the 
above (F2), one can easily prove that |Ky'| = |D,| is free of base point outside x,. 
So we only need to construct a global section of 6Ky' not vanishing at x, . It will 
be done by applying Proposition 5.1. Define 


M1 
y= siog( > Isp iz (7.2) 
p=0 


where N, = dim, H°(M,,,9.,) — 1 and {S;°} is an orthonormal basis with respect 
to the inner product on H°(M,,, Ky’) induced by g,,. Since the base locus of 
Ky: is the point x,, the function y is bounded and continuous outside x,. As we 
remarked in §6, each section S7 is represented by a function in IP(I, p, 1) in the 
local uniformization of x,, where x, is of type C?/Z,, ,,,. In particular, it follows 
that for any neighborhood U of x, in M,,, we have 


fe“dV, =+0 (7.3) 
U 


By the definition of in (7.2), for any tangent vector v of type (1.0) at any point of X, 
we have 


i 14 
(200 + Fest vA r) > |Ivil2, (7.4) 
bes: Ix 


Thus by Proposition 5.1, in order to have a global section of 6 Ky’ nonvanishing 
at x,, it suffices to construct a nonvanishing local section of 6K y' in neighborhood 
of x,. It is obviously possible since x, is a singular point of type C?/Z,, ,,, with 
1 </<3,2 <p S3. Then the lemma is proved. 


Lemma 7.2. Let (M,,9.), Fj; D,, ete. be given as in Proposition 7.1. Then the 
irreducible component in F, intersecting D, has the multiplicity one in B,. 


Proof. We prove it by contradiction. Assume that the conclusion of this lemma is 
not true. First let F, be irreducible, ie. x, is of type C?/Z,,2,,. Then by Lemma 
4.10 and adjunction formula Ky’: F, = F? + 2, there are at least five irreducible 
components C,(1 < a < 5) in B, such that C,-F, = 1. Obverse that the plurian- 
ticanonical divisor K mo is an ample Cartier one, so 


(7.5) 


Choose two generic divisors D,, D;, in |D,| such that D, intersects D , at 8 —n 
distinct points outside B,. Let S’ be the section in H°(M,,, Ky‘) such that 
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{S’ = 0} is just the sum of 2(D’,) and B,. Thus one can compute that 


~ 1 
© dega yee =O BZ S—n +5 16 
where 2,:U, > U, is the local uniformization of M ,, at z with 2,(0) = z. Combining 
(7.6) with (7.5), we get a contradiction to Lemma 6.1. So x, can not be of type 
= 

If x, is of type C?/Z>, > ,, then by the same arguments as above, we can prove 
that B, does not contain more than three irreducible components. Write 
B, = OF, + aF,, +B’, where B’ is an effective divisor having no common 
component with F,. Note that any irreducible component E in B, with E-F, > 0 
can not be snattened to a point by the projection :M,, > M,,, in pantiction: 
E? = — 1. Moreover, if até) does not pass through a singular point of type 
C?/Z,,3,1, then Jace) , 24 and B, contains at most one irreducible component. 
By adjunction formula, it acntietiee to the fact that F,, has multiplicity two in B , 
and F,-D, = 1. So for any such an E, 2(E) must pass through a singular point a 
type CZ, 3,1- Lhen one can easily show that a = 1 and B, = 3n(E), where E is an 
irreducible component intersecting F,,. Let 7,: U x, 7 U,, be the local uniformiz- 
ation of M,, at x,. Then any section S in H °(M a» Ky;') is locally presented by 
a holomorphic function f, on U ,, of form (hg)*f, where h, is the defining function 
of x; *(E) in U,, and deg,( fs) = 1, deg, (h,) 2 1. Since f; is also in J P(2, 2, 1), there 
is at most one monomial term in f; with degree less than 5. Thus we can choose two 
divisors D,, D’, in |D,| such that x(D,) intersects {S’ = 0} at 8 — n distinct points 
outside B, and deg,( fs) 25, where S’ is the section in H°(M,, Ky‘) with 
{S’ = 0} = 2(D) UB,. By Lemma 6.1, 


9-n=3 fa, + f o,, 
n(E) n(D,) 


1 


+8—n+———i,(n; ‘(n(D ,)), {fs = 0}) 


Ss 
ae * de a 


1 5 
8 — a 
5+ nto>9 n 


A contradiction! Thus x, is not of type C?/Z, 2, ,, either. 

Next, we assume that x, is of type C?/Z3.,, then n=6. Let 
B, =aF,, + BFi2+yFi3 + Bi, where F?, = F?; = — 3, F?,=—2 and B; 
does not contain F, ;(1 <j < 3) any more. 


Claim 1. The generic D, intersects F 1. 

If the claim is not true, then we may assume that D Fi, =1,soa=2,B 2 2.1f 
y = 1, then B = 2. By adjunction formula, we have B,-F,,; = 2, B,:F,2=1, 
B',-F,; =0. Let E’ be the exceptional curve in B’, intersecting with F,,, then 
E'-(B , — 2F;2) = 0. It follows that 2(E’) does not pass through any singular point 
other than x, and rational double points, so {,,2,@,, 2 3. By Lemma 6.1, it implies 
that B, = 2(E’) and then B‘ = E’. It contradicts to B,:F,, = 2. Thus y = 2. We 
observe that no E in B intersects two components of F, by adjunction formula or 
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Lemma 6.1. So if we let k; be the number of irreducible components in B; 
intersecting with F, ;(1 <j < 3), then k, + k, +k, <3 by Lemma 6.1. By adjunc- 
tion formula, we have 

1—-6+f6+k,=-1 


2-2B+y+k,=0 (7.7) 


Summing these three equations, we derive y < 1. A contradiction. The claim is 
proved. 

Then B =2 and «+y <3. By the above arguments in excluding that x, 
is of type C*/Z,.,, ome can prove that a=1, y=1. Thus 
B, = Fi; + 2F,2 + Fi3 + E, where E is an exceptional curve of first kind and 
E- F,, = 1. There are now two methods to conclude a contradiction. One of them 
is to use Lemma 6.1. We can easily choose two divisors D,, D’, in |D,| such that 
they intersect to each other exactly at 8 —n distinct points besides x, and 
i,(t; '(D,), 2; '(D, + B,)) = 7, where z,:U, > U,, is a local uniformization of x, . 
It will contradict to formula (6.1) in Lemma 6.1. There is another method described 
as follows. Let M °, be the surface obtained by blowing down E and then F, 2 in 
M., , and F?; be the i images of F, ; (j = 1, 3) under the natural projection from M ,, 
onto M2 Then (F,;)> = — 2(j = 1, 3). Inductively, let M *, be the surface obtained 
by blowing down an exceptional curve intersecting either Fit! or Fi3z!. Put 
Fk; = m(F*; ')(j = 1, 3), where m:M ‘>! + M‘& is the natural ‘sninginns: Let M™, 
be the last surface obtained in such a process. Then (Kqy~)> =4+m. By 
h°(M “asa a) = 4, we have m < 4. It is well-known that the relatively minimal 
rational surface are exactly CP? and Hirzebruch surfaces Yl > 0) (cf. [BPV]). In 
particular, it follows that m = 4 and (F7;)? = 0(j = 1, > So M™ = )). Now any 
anticanonical divisor of Kj‘ descends to the one of Kz x, ’ containing F7,, F73 and 
FT, O FY; with multiplicity = 3. It 7 i that h°(M, , Kyq') < 3. This contra- 
dicts to the fact that h°(M,,, Kq') = 

Hence x, can only be of type C ate 1,3,1- By the same arguments as in proving 
Claim 1, one can easily show that F,,-D, = 1, F,2°D, =0 and F?, = — 2. By 
adjunction formula, we have two oxtail curves E,, E, intersecting F ,, outside 
Fy2 (E, may coincide with E,). In particular, it tiltene that any section S in 
H°(M,,, Ky‘) is locally represented by a holomorphic function f,¢1P(1, 3, 1) on 
U, with ord,( fs) = 3, where 2,:U, > U, is a local uniformization of M,, at x,, 
moreover, we can write f, = Nig:liy. fe, where deg,(f,) = 1 and he, is the defining 
function of 2; 1 (x (E;)) for i = 1, 2. Then we can choose two divisors D, and Dj in 
\D, | such that D, has no common component with D‘ and B, and sneeeanta with 
Di, at8—n seine outside B ,, and the divisor 2(D’,) + B, pit a section S’ in 
H°(M.,, Ku) with deg,( fs) = 7. Thus by Lemma 6.1 pote the fact that 6Ky,' is 
a Cartier divisor, 

9-n=fa,. + fo, + Jo, 


E, E, 


+fo 
D, 





2 


1 1 
3+ 6-7) * Gem)” o(ti '(x(D ,)), {fs = 0}) 


1 7 
SF aes aa ree aan 
=,+6 n+o>9 n 


A contradiction! The lemma is proved. 
Now we consider the last case that F,-D, = 1, F,-D, = 1 and F;-D, = 0 for 
j 23. 


Lemma 7.3. Let (M,,9.), Fj; D, be given as in Proposition 7.1. Suppose that 
F,-D, =1, F,:D, =1. Then M, a exactly two singular points besides rational 
deable. points, one re: them is of type C?/Z;, 2, (1 <1 < 3) and another one is of type 
C?/Z1, 3,1. Moreover, 

B,=F,+F,+E, B,=n(E) (7.8) 
where E is an exceptional curve of first kind in minimal resolution M wo OF M,.- 


Proof. By adjunction formula, it can be proved that the connected component in 
B, containing F, is a chain of rational curves ending at F,. Since the generic 
deinen in \D, | do not intersect F (j 2 3) if such F; exist and the anticanonical 
divisor in M ,, is connected, we conclude that B, isa ‘chain of rational curves with 
F, and F, as two ends. By Lemma 6.1, we can further conclude that 
B, = F, + F, + E and E is an exceptional curve in M,, of first kind. Also by 
Lemma 6.1, one can easily prove that at least one of x,, x, in M,, must be of type 
C?/Z,, 3,1. We assume that x, is of type C?/Z,,3,1. 


Claim. The singular point x, can not be of type C?/Z,, 3.1. 

In fact, if x, is of type C?/Z,, 3, ;, then by Lemma 6.1, one can easily show that 
Dy Fre =1, Fut Fe =1, Fu E =1, Fi, = — 2, Fh = — 5(l = 1,2). Let M4, be 
the surface obtained by blowing down E and F,, in M, _ successively. If 
m,:M,2M’, is the natural projection, then 72,(D,)? = "D? =8-—n and 

n(Fo1)? = 0, *iPad n,(D ,) = 0. This 2,(F21) induces a fibration of M ‘, over 
CP’ with generic fiber CP* such that 2, (D,) is contained in fibers. It contradicts to 
the fact that the generic D, is irreducible and n,(D, )? = 2. So the claim is true. 

Thus x, is of type C2Zi0 1, where 1 </ <3 and | =3 only if n= 6. The 
lemma is proved. 


Lemma TA. Let (M,;9.) E, Fy, Fo; D, be given as in last lemma and 
B, = F, + F, + E. Then |6Ky;'| is free of base point. 


Proof. We first remark that by Lemma 6.1, the generic divisor in |D,| does not 
intersect B, outside the singular points x,, x,. By Lemma 7.3, we have B, = 2(E), 
where E is defined there. 


Claim 1. B, = @. 

We prove this claim by contradiction. Suppose that B, = @, then B, c B,. 
Fix an irreducible divisor in |D,|, say D, for simplicity. Then a :enthmetniesl 
divisor in |2Ky’| is the sum of two sanamnaninel divisors if it contains D,. On the 
other hand, by Lemma 5.2, we have h(M,,Ky')=10-—n, 
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h°(M ,,, 2Ky) = 28 — 3n, where n = 5 or 6. Thus there is a global section S$ of 
H°(M,, 2K) such that {S$ = 0} does not contain D, and intersects with D, at 
17 — 2n points outside B,. By Lemma 7.3, we may assume that x, is the singular 
point of type C?/Z,, 2; (1 <1 < 3). Let x: U x, 7 U,, be the local uniformization of 
M.,, with z, (0) = x, and f, be the holomorphic function locally representing nf SP 
in U x,- Then f, is invariant under the action of Z,,2;, ie, o*f, =f,, where 
o€Z,,2,; is the generator. Then we can choose a local coordinate system (z,, z,) on 
U,, such that x;'(D,) = {z, = 0} and o =o;,2,, as defined in Lemma 5.5. It 
follows from o-invariance of f, and f, is a holomorphic function on z{', 23", (2,22), 


zj'*1z,, z,23'*!. Then one can easily deduce 


ig({ fz = 0}, my *(D,)) 2 41 (7.9) 
By Lemma 6.1 and the above (7.9), we have 


18—2n=2fo, +2) a,, 
B, D, 


1 


= “ 
> 3 +17—2n + Gilt h = 0}, m '(D,)) 


1 
23+ 18 — 2n (7.10) 
A contradiction! The claim is proved. 

The above claim implies that the base locus of |2K,'| consists of finitely many 
points. Define 


N2 
y= sop dy Sk 2) (7.11) 
B=0 


where N,=h°(M,,,2Ky')—1 and {S%} is an orthonormal basis of 
H°(M.,,2Ky') with respect to g,,. Then y is smooth outside the base locus of 
|2Ky'|. The rest of the proof is exactly same as that from (7.2) to the end in the 
proof of Lemma 7.1. 

Now Proposition 7.2 follows from Lemma 7.2, 7.2 and 7.4. Then the proof of 
Theorem 2.2 is completed. 

Fhe discussions in previous sections also yield the following result on the 
degeneration of Kahler-Einstein surfaces with positive scalar curvature. 


Theorem 7.1. Let {(M;,g;)} be a sequence of Kahler-Einstein surfaces with 
C,(M,)? = 9 —n (5 <n 8). Then by taking the subsequence, we may have that 
(M — i, g;) converge to a Kahler-Einstein orbifold (M ,,, g,,) in the sense of Proposi- 
tion 4.2 satisfying: 


(1) if n = 8, then M,, has at most one singular point of type C?/Z;,2,, (2<1< 7) 
besides rational double points; 

(2) ifn = 7, then M ,, has either only rational double points or two singular points of 
type C?/Z,, >, besides rational double points; 

(3) ifn = 5, 6, M,, has at most two singular points of type C?/Z),2,; or C?/Z1,3,1 
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(1 <1 < 3) besides rational double points, moreover, in case M ,, has two of such 
singular points, one of them must of type C?/Z;, 2,1, while another one is of type 
C?/Z1,3,1- 


This theorem generalizes some results of M. Anderson [An] and Nakajima 
[Na] on the Hausdorff convergence of Einstein 4-manifolds with positive scalar 
curvature in case of complex geometry. Precisely, this theorem gives the reduction 
of quotient singular points in the limit Einstein orbifold which is the Hausdorff 
limit of a sequence of Kahler-Einstein surfaces. As we have already seen, such 
a reduction is, in general, completely nontrivial. In fact, we expect that M,, in 
Theorem 7.1 has only rational double points as singular points. If it is true, then we 
have stronger partial C°-estimate than that in Theorem 2.2 and can simplify a lot of 
technical computations in section 2 and Appendices. 


Appendix 1. Proof of Lemma 2.4 


In this appendix, we will prove Lemma 2.4 stated in section 2. First we will prove a proposition 
concerning the evaluation of rational integrals. 

Let f be a holomorphic function defined in the ball B,(0) < C? with center at the origin o. For 
simplicity, take R = 1. For any e€(0, 3), xe B,(0) and « > 0, we write 


dV 
een San 


where dV denotes the standard euclidean volume form on C?. 
Then we can associate a local analytic invariant «,(f) to fat any point x in B,(o0) as follows, 


a,(f) = sup{a|de > 0, s.t. I,(f, a, x) < 00} (A.1.1) 


Note that «,(f) is independent of choices of local holomorphic coordinates at x. 

We would like to evaluate «,(f) in terms of the geometry of Z, at x, where Z, is the zero locus 
of fin B, (0). Obviously, if x ¢ Z,, then «,(f) = + oo. Furthermore, by some elementary computa- 
tions, one can easily check that if x is the smooth point of the reduced curve (Z,),.4 of Z, in B, (0) 


1 
and m is the multiplicity of Z, at x, then «,(f) = —. Note that (Z,),.4 is defined as follows, write 
m 


Zp=%,Z, +... +%Z,, where Z(1 <i < k)are distinct irreducible components of Z, in B, (0), 
then (Z,),.g = Z,; +... + Z,. Therefore, it suffices to evaluate «,(f) at the singular point of 
(Z5)req in B,(0). Without losing generality, we may assume that o is the unique singular point of 
(Z5)reg in By (0). s 

Given any local coordinates (z,, z,) of C? at o, one can expand fin a power series Ri > 9 4j24 29 
in a small neighborhood of o. Then we define the Newton polyhedron N(f) of fas the convex hull 
of the set {(i, JER, x R,, (0, + ©), (+ 0, I)Ia,, + O} in R?. The boundary dN(f) intersects 
with the line {x = y} in R? at a point (x, y,), where x, y are euclidean coordinates of R?, x; = y,. 
This x, is called in [AGV] the remotedness of N(f), denoted by r(N(f)). Since N(f) obviously 
depends on the choice of local coordinates C? at 0, so does r(N(f)). However, we have 
Proposition A.1.1. Let f be given as above. Then there are a sequence of coordinate system (27, 23) of 
C? at o such that for the associated Newton polyhedron N,,( f) in the coordinate system (z", 2), we 
have r(N,(f)) S (Npy(S)) if m Sm! and «,(f) = lim,, . .1(Na(S))*- 


1 
Proof. It is clear that «,(f) < —. Write f=f, +f,,, + ..., where each f; is the homogeneous 
m 


component of f with degree j, k= mult,(f). Obviously, ky = mo. Take « < m,', then for any 
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e>0, 


A (A.1.2) 
< A. 
B,(0\B,0S1* 
By a linear transformation, we may assume that f, = 2425 [[/-,(z; + #22) with pw, +0 
distinct, a > b > c;(i=1,2,..., )anda+b+ ¥/_,c; =k. Let N(f) be the associated Newton 
polyhedron in R? of f in this coordinate system. 


Case 1. ON(f) {x =y}a{x+y=k} + @. Note that in this proof we always use x, y to 
denote the coordinates of R?, z,, z, to denote the coordinates of C?. 
In this case, we will prove that «)(f) = 2/k. In fact, for 6 > 0 sufficiently small, we have 


Lf. ' j dV f dV j dV 
lf % 0) = * 7 7m 
B;(o) fl? Ix] S |yl If? Iyl S bl fl? 

Ix}? + |yl? $6 Ix}? + ly? <6 


<j dy n dy ndé n dé 


> I 2a 
wer WITT E+ ms + YL y*hvey) 


m2k+1 


(A.1.3) 





dx \ dx a dyn a dy 
+ j l 2a 


et bP 2t TT + ma + xx, 20) 


i=1 m2k+1 





2 
It follows that I;(f,«,0)< +00 only if « as On the other hand, by our assumption, 


k 
b+ Y!_,¢;2a,a>b2¢,, so max{c;,b,a} < > Thus both polynomials *] ]/_ , (€ + u;)* and 


k 
n’| [i-, (1 + in) have roots with multiplicity < 5" We also have 


Y yfalyéy)=0 aty=0 
m2k+1 


y x *f,(x,xn)=0 atx =0 


m2k+1 


2 2 
Therefore, for 6 sufficiently small, both integrals in (A.1.3) are finite if a < r So a,(f) = i 


Actually, we have already proved that /,(f, «, 0) has a upper bound depending on 6, « and the 
upper bound of | f| in B,(o0). 


Case 2. ON(f) {x =ysa{xty=k}= mS. 

Nowa>b+)!_, c;. Let L(u, v) = {ux + vy = 1} be the unique line containing the segment 
of dN(f) having nonempty intersection with {x = y} in R?. Thus a,(f)= r(N(f))~*. In the 
following, we may assume that L(u, v) is not vertical. In fact, if L(u, v) is vertical, then by Fubini 
theorem, one can easily check that I,( f, a, 0) is finite iff « < r(N(f))~*. Note that r(N(f)) is the 
distance of the line L(u,v) from y-axis in R?. Let (i,j) and (i’,j’) be the two end points of 
L(u, v) 0 ON(f) with i> j, i’ <j’. We further have that i> i’, j <j’ and i’ + j’ 2i+j. A simple 
computation shows 


sr 


i-i i-i’ 
= ° v= 
ij’ — ji’ ij’ — ji’ 


~ 


u 


~ 


' - a B > , 
Then there are integers @, & 7 such that u = —, v = — and @, f are coprime. 
Y Y 
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Define a polynomial f, by yn De L(u,v)reN(f) 42122: There are at most i terms in f,. This 
polynomial f, has the decomposition, 


SulZy 22) = ez! 24 T] (cf + dz (A.1.4) 
k=1 
where c+0 and d,,...,d, are distinct constants. Note that )y_, Bu, +i’ =i, 
Yi-: %,+j=/'. For 6 > 0 sufficiently small, let 6, = 5", 6, = 6, 5’ = min{6,,6,}, then we 
have 


; = cata a3 \w, [22-2 |w78-2 dw, a dw, a dw, a dw, 
3(f% 0) S j ya miles &@ b\\2a 

é If (wt, wd] 

5 





Zi 
iz, <6, S21, 22) 2 \w, < 
lz $ 6, |w2| S 


dw, Adw, Adn adj 





=z f 


ils é |w [227 28-28 +2 | opi TI (1 + any + wy 77 (w4, wen) 
k=1 


dw, a dW, a dé a d& 


2a 





+B f : 
Jw] $5 |w, [227 ~ 24 - 28 +2 ce Il (E+ 4," + wr IF (wi, wh) 


els 
k=1 


2a 


~ 


* +B 
where f = f — f,. It follows immediately from (A.1.5) that I;,( f, a, 0) < + 00 only if «< . 
Y 


By the definition of r(N(f)), we have i’, j <r(N(f)) = "yf Since w,? f (wi, wh n) =0 at 
a 


w, =0 and wy f (wi ; wh) = at w,=0, one can easily show that I,,(«,f,0)<o if 
1 

max, <,<,{M} <— and a<r(N(f))~'. Thus if u, Sr(N(f)) for all k, then I,.(a,f, 0) < 00 iff 
Nes a 

a <(r(N(f)))~', ie, a(f)=r(N(f))~' and the proposition is proved. Otherwise, there is 


l 
a pw, > r(N(f)). For simplicity, say k = 1, ie. uw, > r(N(f)). Then by the fact that — a > > we 
a 
derive B = 1, > 2. Note that other bh, for k = 2 are all less than r(N(f)). 

Making a transformation (z,,z2)—(z, + 423,22), we obtain a new local holomorphic 
function g at o with f, as the first homogeneous term g,. Also we observe that all points on 0N(f) 
below (i, j) are unchanged and are still the ones on 0N(g) below (i, j)€ 0N(g). Put No(f) = N(f), 
N,(f) = N(qg). Note that g is just the function fin the new coordinate system. The above process 
can be carried out successively to obtain Newton polyhedrons No(f), N,(f), . . . , unless for some 
mM, %o( 7) = r(N,,(f))~ ' and the proposition is proved. Suppose that such a m does not exists, then 
we have a sequence of Newton polyhedrons No(f), N,(f),...in R?. Moreover, the parts of 
ON,,(f) (0 Sm < oc) below the line {x = y} are all same. Then one can easily check that 
lim,, + o"(Nm(f)) = i. By previous discussions, I;(f,«,0)< + oo for sufficiently small 6 > 0 if 


a<i-',and a,(f) <r(N,,(f))~ for all m. Thus «,(f) = i~1, the proposition is proved. 
Lemma A.1.2. Let M be a smooth complete intersection of two quadratic polynomials in CP* and 
S be a global section in H°(M, K,,°) such that its zero locus Z(S) contains no curve with multiplicity 


9 and Z(S),.4 is not a union of two lines and a curve of degree 2 intersecting at one point. Then there is 
an ¢ > 0 such that for any «543+, 


dV, 
—asiie <+0 (A.1.6) 
u ISI; 
where g is any fixed Kahler metric on M. 


Proof. By our assumption, there are finitely many points x,, ... , x,¢ M such that for any 6 > 0, 
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a < 3 (cf. Fact(t) in the proof of Lemma 2.3), 


dV; 
a3 <+0 
Siz 


(A.1.7) 
M\\ i= Balx;" 9) | 
where B;(x;, J) is the geodesic ball at x; with respect to g. At each point x,, the section S is locally 
represented by a holomorphic function f,, we define a, (S) = a, A f,). This ,, (S)i is in fact indepen- 
dent of the choice ap local representations of S. Then one can easily see that the lemma is 
equivalent to «,. (S) > 43+ 2¢ for 1 <i < I, Suppose that the lemma is false, then there is a x;, say 
x,, such that a, -(S) < 4. We will derive a contradiction to our assumption on S. 
Let (z,, 22) be the local holomorphic coordinates of M at x,, and S be represented by a local 
holomorphic function f,, then 


mult,(fs) = a,(fs)' = a, (S)"1 =9. (A.1.8) 


Claim 1. There are at most one line of M through the point x,. 

We prove it by contradiction. Suppose that there are two lines L,, L, of M through x,, then 
there is a unique anticanonical divisor D = L, + L, + E, here E is a curve of degree 2 with respect 
to K my and x,¢€E. Note — by smoothness of M, L,, L,, E must intersect to each other 
transversally at x,. By K,,'- L; = 6 for i = 1, 2, we have that 2L, + 2L, c Z(S). Let /,, 1, be local 
defining functions of L,, " ye fs= PPh. By Holder inequality, the facts that «, (S) < $ and 
Xp (1,/,) = 1, we derive mult,(h) = 7. Thus 8 = (Ky° — 2L,)-L; = 9 unless 3L; < Z(S) rp 1, 2. 
Hence, 3L, + 3L, < Z(S), ie., fs = (1, 1,)2h,. Now mult,(h) > 6. We claim that mult,(h) = 7. In 
fact, if not, then by Proposition A.1.1 and «, AS) si, for any p > 0, there is a local coordinate 


er 

system (z,, 22) such that h,(z,,2z,) = Dijz 0 424 zi, at (0,0) and a,; = 0 if either <+°< 1 or 
P 

: ae 1, j = 1. In particular, the lowest homogeneous term f,, of f, is of form 1?/3z°. Thus by 

Proposition A.1.1, %9(f) = 2 unless one of L,, L, is tangent to {z, = 0} at x,. Assume that L, 

does so. If 4L, ¢ Z(S), then 


= (6K,,' — 3L,):L, =3 + {h, =0}-L, 
2 3 + inf{2i + jla,; + 0} 
=3+13=16 


A contradiction! Therefore, 4L, < Z(S). One can actually prove that 5L, < Z(S). Choose local 
coordinates (z,,z,) such that L; = {z; = 0} for i = 1, 2. By Proposition A.1.1 and «,(S) < 3, if we 
write f, = z*z3h,(z,,z,) where 8 = k = 5, then h,(z,, z,) =(z, + 24)°-* + h,(z,, z,) and h, does 
not have terms z/z/, with i + j/B < 9 — k. By some direct computations, we can obtain a,(S) > 4, 
a contradiction! Thus we must have that mult,(h, ) = 7, so mult,( f,) = 13. Since Ky,°: E = 12, we 
rs that E < Z(S), so S = S’-S,, where S, is a global section of K = By Hdlder inequality, 

a, (Ss) S$ < %. Repeat the above arguments for S;, we can conclude that S, = S’-S, with 

a, (S.) < <h. ledeuedy, we finally obtain S = (S’)®. By the definition of S’, it contradicts to our 
assumption on S. Therefore, Claim 1 is proved. 


Claim 2. There is no line of M through x,. 

If not, by Claim 1, there is exactly one line L, of M with x, € L,. As before, 2L, < Z(S). By the 
above arguments in the proof of Claim 1, it follows from a, ,33 3 that mult,(f,) = 10, where f, is 
the local holomorphic representation of S at x, 

Let f, be the lowest homogeneous term of ry at x,. We may assume that there are k,, k, with 
k, +k, =k satisfying 


k, = max{l,,1,|1, +1, =k, zz? is in f.} (A.1.9) 


In particular, k, = k,. Give a partial order on monomials z/'z3:z/'z? < z/iz'f if 1, <I’. Let 24'z? 
be the smallest term in f, with respect to the above partial order. If j, <j,, then by the proof of 
Proposition A.1.1 and a, (S)s <4, k=18. Choose an anticanonical divisor S’ such that 
Z(S') = L, + Dand Dis tangent to L, at x,. By Claim 1 and the properties of M, the divisor D is 
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irreducible and smooth at x,. If Z(S) does not contain D, then 
18 = Z(S):D = 16 + 2L,-D = 20 


A contradiction! So Z(S’) < Z(S). Inductively, we can prove S = (S’)®. But mult, ((S’)®) = 12. It 
contradicts to that k = 18. Thus j, >j,. In particular, k, > k,. Note that the same arguments as 
above show that k < 14. By the geometric properties of M, one can easily check that there are 
exactly five curves D,(1 <i <5) of degree 2 through the point x, and with distinct tangent 
directions at x,. If k = 14, then Z(S) = 4L, + 2)°?_, D,. It implies that a, (S) 2 4, impossible! If 
k = 13, then 4Z, + )}?_, D, < Z(S). One can also show that it will be against our assumption 
a, (S) S 3. Thus k < 12. Since «, (S) <3, j, 2 9 and j, < 3, where zi‘z? is the smallest term in f,. 

Choose an anticanonical section S” such that Z(S”) = L, + D’, where D’ is tangent to {z, = 0} 
at x,. 

By Proposition A.1.1 and a, (S) < 3, we can choose (z,, z,) such that the Taylor expansion of 
fg at x, does not have terms z‘z4, with i(9 — j, — 5) + j(j, —9 + 6) <(9 — 6)(j,; —j,), where 
6 > 0 is sufficiently small. Then if D’ ¢ Z(S), we have 


Z(S): D’ = min {2i + j|z/z4 is in fy} 
> min {2i + j|z/z4, is in fe, i < 8} 
27 — 2j, —j 
B64 —b- 8, (A.1.10) 
j,-9 
where 6’ is small and depends on 6. First we assume that D’ is irreducible, then by (A.1.10), 
D' < Z(S), so S = S"-S,, where S, is a global section of K,,°. One can compute that 


j ell < it p<? (A.1.11) 
——_<o i -. A. 
au WS"5? 4 
Then by «, (S) < 4, we have «, (S;) S #. In fact, one can easily prove that L, is also tangent to 
{z, =0}. Inductively, we will conclude that S =(S”)®. It implies that a, (S) 2 da, (S”) = 4. 
A contradiction! Therefore, D’ is reducible. It will have distinct tangent direction from that of L, 
at x,. Then we have that j, = 9, j, = 3 and L, = {z, = 0}. By Ky,°- D’ = 12, Proposition A.1.1 
and D’ is tangent to {z, = 0}, one can deduce that 5D’ + 2L, < Z(S). Then by the arguments in 
the proof of Claim 1, we will have either «, (S) > $ or 9D’ < Z(S). Since both cases are impossible, 
we complete the proof of Claim 2. 

From now on, we may assume that no line of M passes through x,. Then there is a pencil of 
anticanonical divisors such that the generic one of it is irreducible and vanishes at x, of order 2. In 
particular, it implies that k < 12. 

By Proposition A.1.1 and a, (S) < 3, we can choose local coordinates (z,,2,) such that 
the Taylor expansion of f, at x, does not have terms 2,24 with 
(9 — 6 —j,)i+U, —9 + 5); $9 — 6)(j, — Jj), where j,,j, are given in the proof of Claim 2, 6 is 
sufficiently small number. On the other hand, we have an anticanonical section S’ such that its 
local holomorphic representation hg, is of form z,h ,(z,, 22) + 23h (z2) at x,. 


Case 1. Z(S’) is irreducible. 
If Z(S) does not contain Z(S’), then 


24 = Z(S):Z(S’) 
= min {2i + j|z,z4 is in fg} + min{i + j|z\z4, is in fy} 
2 18+9=27 
A contradiction! Thus S = S’-S,;. An easy computation shows that a > 3,s0 a, (Ss) s %. 
Case 2. Z(S’) is reducible. 


By Claim 2, the divisor Z(S’) consists of two curves D,, D, of degree 2 such that both D, and 
D, are smooth at x,, D, is tangent to {z, = 0}. As in Case 1, we have D, < Z(S). Let g, be the 
defining equation of D, at x,, then a(g,) = 1. So if we decompose f, = g,f, then a9(f) < 3, 
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mult,(f) < 11. Then one can deduce 2D, < Z(S). In fact, the same arguments show that 
3D, < Z(S). On the other hand, arguments in the proof of Claim 1, one can show that 
k = mult,(f,) = 10. Thus if D, ¢ Z(S), we would have 


12 = D,-Z(S) = 3D,-D, + D,(Z(S) — 3D,)) 
>64+7=13 


A contradiction! Therefore D, < Z(S), i.e., S = S’S;. Also a, (S) < 4 
Inductively, we can prove that S = (S’)°, then « x,(S) 2 >it contradicts to our assumption. 
Thus the lemma is proved. 


Lemma A.1.2. Let M be a smooth cubic surface in CP? and S be a section of Ky,°. Assume that 
Z(S),¢q iS not an anticanonical divisor consisting of three lines intersecting at a common point. Then 
there is an ¢ > 0 such that for «<4 +6, 


dV. 
f-—t <a (A.1.12) 
uw WSHg 


where g is any given Kahler metric on M. 


Proof. As in the proof of last lemma, it suffices to prove that a,(S) > for 1 <i<l, while 
a,(S) > $ for any x + x;(1 <i <1). Assume that a, (S) < 4, we will derive a contradiction. Since 
the proof is identical to that of last lemma, we just sketch it. Note that there are at most two lines 
through x,. 


Case 1. There are exactly two lines L,, L, of M through x,. 

In this case, there is an anticanonical section S’ of Ky’ with Z(S’) = L, + L, + L;, where L, 
is a line of M not through x, . Then as in the proof of Claim 1 in Lemma A.1.1, either 4L, + 3L, or 
3L, + 4L, is in Z(S). But L,-L3; = 1, L,-L3; = 1, so L; c Z(S), ie., S = S’-S;. One can Sal 
compute that a, (S’) = 1, so a, (Ss) < < 4. Inductively, one can show that S = (S’ 6. then a, (S)2 
A contradiction. 


Case 2. There is exactly one line L, of M through x,. 

Let S’ be the section of Ky‘ with Z(S’) = L, + D, where D is an irreducible curve of degree 
2 containing x,. As before, 2L, < Z(S). Let f, be the local holomorphic representation of S$ in 
some local coordinates Ae ,Z2), and /, be the defining equation of L,, then f, = /7h, mult,(h,) = 7 
and «,(h,) <4. Let f,, h,_, be the lowest homogeneous terms of f,, h, respectively. Then we may 
assume that he. = z/'72 + ... and any term z/z/ in h,_, has the property: izj,. If L, is not 
tangent to {z, = 0}, then f, = jzitzi*? +. _ satisfying: A + Oand no z\z4 inf, with i < j,. By the 
proof of Proposition A.1.1, j, 29, so k > 11 and 3L, < Z(S). Consequently, it follows from 
L,:D =2 that Dc Z(S), ie. S = S’-S,. If L, is indeed tangent to {z, = 0}, then we can prove 
that 4L, c Z(S), so D c Z(S), otherwise, 


12 = D-Z(S)>4L,-D+(k-4)284+5=13 


A contradiction! 
en we always have S = S’- S,. Then inductively, one can actually prove that S = (S’)°, 
SO a, (S) = $a, (S’) = 4. A contradiction. 


Case 3. There is no line of M through x,. 

Let S’ be the anticanonical section vanishing at x, of order 2. Then Z(S’) is irreducible. If 
Z(S’) < Z(S), then S = S’ Py where S, is a global section of K,,°. One can directly check that 
ax,(S’) =, so ax,(S;) S #5. In particular, S; vanishes at x, of order at least 8. Thus by 
Z(Ss): Z(S')= 15, we continds Z(S') < Z(S,). Inductively, we have S=(S’)®, so 
ay (S’) = da, (S’) > 3. A contradiction. 

Now Z(S’) ¢ Z(S). It implies that k = mult,( f,) = 9. By Proposition A.1.1 and a, (S) < 3, we 
can choose local coordinates (z,, z,) such that f, does not have terms z’z/, in its power series at x, 


if 5 +- J < 1, where p is a sufficiently large integer. In particular, the lowest homogeneous term f, of 


My 
is z?. By using the holomorphic transformation of form (z,, 2.) > (z,; + bz, z2), we can 
s 1S Z; Pp k>1%22 
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eliminate the monomials ziz, for | 2 1 in or Taylor expansion of f; at o. Then the proof of 
proposition A.1.1 implies that either a, (S) > 4 or fg contains a curve with multiplicity 9. Both 
cases are impossible! Thus we also derive a contradiction in Case 3. The lemma is proved. 

The Lemma 2.4 in section 2 obviously follows from Lemma A.1.1 and A.1.2. 


Appendix 2. The Proof of Proposition 2.1 


Let {f,},;>, be a sequence of holomorphic function in the unit ball B,(0)< C? with 
lim,.. ,, f, =f + 0. We want to prove that for « < inf, , (0) 2 a.(f)}, 


dV dV 
lim f a ) 


(A.2.1) 
2a 
i-o Bo) Fi Bo |S 


where dV is the standard euclidean volume form. 
As before, we denote by Z(f) the zero locus of f and Z(f),., the sum of distinct irreducible 
components in Z(f). Without losing the generality, we may assume that Z(f),,, is smooth outside 


1 
the origin o. Then «,(f) = — for x + 0, where m, is the multiplicity in Z(f) of the irreducible 
mM, 


component of Z(f),,, containing x, m, = 0 if x¢Z(f),,4. On the other hand, m, is the Lelong 
number of (1,1)-positive current 06 log| if |? at x. By the estimate in [TY], for any small neighbor- 
hood U of 0, and any B < min, . B,(o) % a,(f)}, there is a constant Cy g independent of i such that 


dV 
B z U Wala S Cup — 


It implies that 


lim  f Saat j pal (A.2.3) 


2a 
i-oB 3 (0)\U fil’? B,(0)\U fl 


therefore, by the famous Fatou’s aaa, in order to prove (A.2.1), it suffices to find a small 
neighborhood U of o such that 


aw dv 
lim j n= 2a 
izau lhl yl 


Lemma A.2.1. Suppose that for sequence {F;},. of holomorphic functions in a neighborhood of 
o with lim,_, ,, F; = F + 0, there is a constant C, independent of i such that for « < a,(F) 


dV 
f $C, <0 (A.2.5) 
U |F;,|?* 


where U is a fixed small neighborhood of o. Then (A.2.4) is valid. 


(A.2.4) 


Proof. Since a < a,(f), by taking U smaller if necessary and using Proposition A.1.1, we can 
choose local coordinates (z,,z,) at o such that we have the following expansion of f 


n(f) 
f (21,22) = zizi I] (24! +A, 2 PP + fr(Z1, 22) 


v=1 
= fs(Z1, 22) +fp(Z1, 22) 
where 


1 
(1) hod Py <= 1,1,...,n(f). 


(2) A is a line segment in the first quadrant R? of R? and f, contains exactly terms z‘z!, in the 
expansion of f with (k, l)e A. 
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(3) For any term z‘z/, in the expansion of fy (k, /) lies on the right side of the line in R? con- 
taining 4. 

(4) « <r(N(f))~', where r(N({)) is the remotedness of the associated Newton polyhedron of fin 
local coordinates (z,, z>). 

Define ¢, = K max, {| f, —f|}, where K = 2 is a constant determined later. Then 


dV 
lim j 


well 


— av 

% Bh § —nnnee foeeet fe 

ae 0-85 ice lhl™ 
U 


os 


Pee av 
=x f =, + lim ) 
pas Pee inset 


Therefore, it suffices to prove that the last integral in (A.2.7) tends to zero as i goes to infinity. 

We may take U to be {(z,,z,)€C7||z,| < 6", |z,| < 5}. In the following, all integrals are 
taken on the subsets of U as specified. 

We decompose the last integral in (A.2.7) into three parts J;,(¢,), J;2(¢;), J;3(e;) and estimate 
them individually. First we deal with J,,(¢). For that, we put z,= wh, z, = wh€, 
m = iyi, + jaj2 + init Dyas Pv 5; = & then 

dV 


Wits (A.2.8) 


Ji (€;) = f 
\fl Se; 
\z, 4 s \z,|!2 
"Vieal 2 4, 
° f |w[it — 2+ 22dw a dw a dé a dé 
fl se; |fi(w'2, wi)|? 


5, S |wl, ix'| $1 





; Jw + 2-1 - ma dw ~ dw a dé a d& 
= j F 
5 figs IT] E+ AP + wofalwiewh) + (fF, — SP 
v=1 





By the definitions of 6; and fp, for 6; S |w| S$ 4 
wo "few, wi )+wo™"(f,—f)| SC5+K~" (A.2.9) 


m 
———., we have that ai, <1, 
Ji TJ2 

p,:« < land ma — j, + 1 —i, < 1. Thus if we choose K sufficiently large and 6 sufficiently small, 


by Fubini theorem and (A.2.8), (A.2.9), one can easily see lim,_, ,, J;,(¢;) = 0. Similarly, one has 
lim,_, ,, J;(e;) = 0. Note that 


where C is a constant depending only on fp. Since r(N(f)) = 


dV 


TH (A.2.10) 


J2= j 
fl se; 
lz," S |z,I"2 


fz, 6, 


Next, we estimate J;,(¢;), which is dominated by the following integral 


I(f,9= Jf <(4-4) (A.2.11) 
6p Ji 


Iz,1S 
lz'| Sop 
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Define holomorphic functions F;, F by 
m 4 iy 
F(z;,22) = 4; *§( 6, 21,5; tn) 


F(2,,Z>) = fx(Z1, 22) (A.2.12) 


For i sufficiently large, those functions are well-defined on U with lim;.,F;=F and 
a < 4 (F) =r(N(f))~'. By the definition in (A.2.11) and (A.2.12), we have 


I (fea) = 5,2 Te (Fu) (A.2.13) 


It follows from our assumption of the lemma that lim, _, fe I, (f;, ®) = 0. Then, the lemma is proved. 


It remains to verify the assumption in Lemma A.2.1. We will complete it by induction. For 
simplicity of notations, we assume that F; = f;, F =f. By the proof of Proposition A.1.1, there is 
a local coordinate system (z,,2z,) such that either %)(f)=r(N({))~', where r(N(f)) is the 
remotedness of the associated Newton polyhedron N(f), or f(z;, 22) = zi'zi! + fg(z;, 22) with 
ao(f)=i;' <j,‘ and pl+1> pi, +j, for any term z‘z} in fp, where p is a sufficiently large 
integer. First we assume ya in the second case. Then we can write f, = f,, + z/'z4! + fiz, where 
fy, consists of all terms z‘ 2,in f, with pk + 1 < pi, +j,. By the holomorphic transformation of 
form (z,, 22) 2 (2; +), > a z,), we may further assume that f,, does not have the term z/'~ 'z/, 
with | > j, + 1. Note that lim;_., f;, = 9, lim;.. fig =f. Furthermore, by holomorphic trans- 
formation, we may assume that each fy, does not contain any term z/!~'z) with | > j,. 


If fin = Dipk +1 < pi, +j, Mil)2429, We define 


1 
¢, = K max uO ——— } (A.2.14) 


where K is a large constant independent of i. We decompose 


dV dV 
= + + 
J J J J line 
1 


2a 
uhil lz,)Slz21? = lz, S lel 


lz 
lz2| 2 & lz.)2e5 lz 
<a Jilhis é;) + J,,( i> &) oF ee ot) (A.2.15) 


It is easy to show (cf. the proof of Lemma A.2.1) that both J,,( fj, ¢;) and J,,(fj, ¢;) are uniformly 
bounded if K is sufficiently large. Put g; = ¢; +i 6 (PZ, | £,Z>). Without losing generality, we 
may assume that lim, - g; = g. Obviously, the holomorphic function g is the sum of z/'z/! and 
some monomials b,,24 2, with pk + | < pi, +j;. 


Claim 1. For any point x in B,(0), we have a,(g) = a,(/). 
We may take x to be o since the translations on C? preserve the property that g is a sum of 
zi'z}' and some monomials b,,z4 2, with pk + | < pi, +j, and k <i, —1 ork =i, —1, I1<j,). 
Let N,(g) be the Newton polyhedron associated to g and coordinates (z,, z,), let A’ be the line 
segment in ON,(g) intersecting with the diagonal line {x = y} in R?. Define 


YY by zkz, where g = ¥. busi, (A.2.16) 
, (k, Jie’ pk+ tS pi, +i, 
Then we can write 


nig) 
Gy = zz [] (2 + Ayz2) (A.2.17) 
v=1 


By the proof of Proposition A.1.1, we have 


og 
20 ( max (ANDi is.) (A.2.18) 


Isvsn(g) 
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On the other hand, we may assume p so large that there is no integer pair (k, 1) in R? with 
pk +1 < pi, +j,,k > i, and k 2 I. In particular, it implies that r(N,(g)), i,j, p,, S i. It follows 
that «,(g) = «,(f). The claim is proved. 

We also observe that mult,(g,) Si, +j, and a,(g)>a,(f) whenever mult,(g) = i, + j,. 
Thus by induction on «,(f), i,, i; +j,, etc., we can verify the assumption of Lemma A.2.1 in this 
special case. Note that i, and i, +j, are determined by the lower endpoint of the line segment 
A (cf. (A.2.6)) of 6N(f) for a more coordinate system. 

Next, we may assume that in the local coordinates (z,,z,), %(f)=r(N(f))~' for the 
associated Newton polyhedron N(f). Let 4 be line segment in 0N(f) intersecting with {x = y} in 
R? with the properties stated as in (A.2.6) of the proof of Lemma A.2.1. Note that n(f) = 1. 
Furthermore, if j, = 2, then f, does not have any monomials z‘ z), with k = i, + j, ¥", p, — iif 
j; = 1, by the transformation of form (z,, z,) > (z, + cz}, z,) and using the fact that i,, j, and all 
Pp, are less sa r(N(f))~', we may also assume that f, does not have any monomial z‘z! with 
k=i, +h dye) p— 1. 

We decompose f; = f;, +f, +Jiz, where f,, is the part of f, consisting of all terms z‘z) with 

L4(k, |) < Oand L, denotes the defining equation of the line containing 4. By scaling, we may take 
U to be D, x D, in C’, where D,(r > 0) denotes the disk in C of radius r, and f to be f,. It follows 
that lim; fiz = 0. 
Claim 2. There are local biholomorphisms ¢$; = D, x D,; — D, x D, such that (i) converge 
uniformly to the identity as i goes to infinity; (ii) the Taylor expansions of f;o d; at o do not contain 
terms zz, with either L,(k,1)<0 and k>k, =i, +j,¥'_,p, or k=k,—1, |>j, and 
L4(k, 1) + 0; (iii) lim, ,, fio d; =f on D, x Dy. 


Note that (k,,j,) is the lower end point of 4 with k, 2 j,. We define ¢; by equations 


mm fn 
$)(2,, 22) = (x12 +n+>d ¥ bunts (A.2.19) 


k=11=1 
where n, is a large integer. Then one computes 


i. Jed t 
a(n + nit x 3 bunts 


k=11=0 


ny , st. 
=2(z,+n) +tz, ¥ AY by z4(z. +0, ' + Obl’) (A.2.20) 

k=1 1=0 
where O(|b|?) denotes a quantity bounded by CY, )5 9 lbyl? Let fr= Lyra o4uliziz4 and 
5°; = > 9g (i232 the Taylor expansions, then lim,_, , a,,(i) = 0 whenever ,!) +0. 
fie bi = Lez oCnl)2122 be the Tayl ions, then lim, ., ,, 4,,(i) = 0 wh L(k, 1) +0 


Moreover, for any (k, !) with | <j, and n, > k > k,, it follows from (A.2.20) that 


: t—1 
qid= ¥ aot ¥ 6-0 ' er + O(|b|?) + O(\a\) (A.2.21) 
s,t20 j=0 J 
where O(|a|) denotes a quantity bounded by Crk 1) +0 4,,| and we let b, _,; be zero ifk —s 0. 
By Cauchy formula, one can show that those (4)'**a,(i) with L,(s, t) +0 converge to zero 
uniformly as i goes to infinity. We choose n; < } satisfying 


1 st+t 
lim n; = 90, sup (5) a,,(i) <n; (A.2.22) 


ima@ L,(s, 0) +0 

By either using Implicit Function Theorem or an iteration, it follows from (A.2.21) that there are 
{b,,(i)} with lim,_, ,, b,,(i) = 0 such that c,,(i) = 0 for those (k,!) with k, < k <n, and! <j,. We use 
these {b,,(i)} in the definition (A.2.19) of @;, then these @; satisfy (i), (iii) in the statement of Claim 
2 and the Taylor expansions of f; ; do not contain terms z}z', with n > k > k,, 1 <j,. Next we 
construct a local biholomorphisms #7 of torm (z,, 22) > (z, + ), >1 d,z‘, z,) to eliminate terms 
zk 12! in f,o d; with | > j, and L,(k, — 1, 1) + 0. Then our biholomorphisms ¢; are the composi- 
tions ¢;° ¢;. The claim is proved. 
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In particular, Claim 2 implies that the Jacobians Jac(@,) of ¢; are uniformly bounded on 
D, x D,. Therefore, it suffices to prove that So. x D, \f,o@,|" 2*dV are uniformly bounded. For 
simplicity, we still denote f,o ; by f,. Thus each f,, does not contain any term z*z!, with L,(k, |) < 0 
and either k > k, ork =k, —1,1>j,. 

Since lim,_, ,, ‘ =z 0, without losing generality, we may assume that 

Ifinleyp, xD,) = <6 for alli (A.2.23) 
where 6 > 0 is a sufficiently small number determined later. 

Define m = i,i, + j,i. + (D4 =1 Pyi2j, and 

1 
€; = K max {|a,,(i)|m-i2k-i1 |L,(k, 1) < 0} (A.2.24) 


Lemma A.2.2. Let h =); > by242) be a holomorphic function on D, x D, < C? such that 
b,, = 0 if La(k, 1) <0. Then we have 


(i) for \e| $1, wh" $4, we] <3 

iw, é, wi) < (2IwI"lAlca, x Dy (A.2.25) 
(ii) for || <1, |wl? <4, we] <4, 

|h(w?2é, wit €)| < (2|wl)"lhlcup, x D,) (A.2.26) 


Proof. We just prove (i) here. The other case is analogous. For any fixed € with |é| < 1, by ont 
assumption on h,, the function w ~™h(w'?é, wt) is holomorphic in the domain E, = {iwi < 
|w'2é| < 4}. Thus maximum principle implies that for 


sup |w~h(w,,¢, w*)| < sup|w~"h(w?é, w’*)| 
E, aE, 
S2"Ihlcup, x d,) (A.2.27) 


The inequality (A.2.20) follows from it. Similarly, we can prove (A.2.21). 
We then compute 


dV 
+ j + f (A.2.28) 


ia j i2 i i2 fi y 
Vinls4/iedl Riedel alse i 
& $ ¥/lz,I Riz) 2 6, lz| Sef! 


|wI22 + 2j, —2 — 2ma dy A dw A dé A dé 





ei 
SJ 1 2a 
& Siw Sn 


I 
lS 1, |we] 4 OTT (E+ A, + wo (fi (2S, w"') + fig(w?é, w'')) 


v=1 


ee |w)2iz + 2, —2— 2ma gw n dw a dé a dé 
by 





1 2a 
& Siw <a 


ll S 1,|wg| $4 
~ ,( Sis ® 
= Jie (fs a) + J, (fir a) + I, (fi, ) 
Since the nonzero roots 1,,4,,..., A, are distinct, we have 


A=min{|A, —A,),1a, -—Al ALA AI iNsu<vs3}>0 9 (A.2.29) 





I 
CT] (1+ AEP + wom (fin (ww, wid) + figlw'?, wt) 


v=1 


1 
By (A.2.19) and Lemma A.2.2, for (3): = |w| 2 ¢;, |€| S 1 and |w2é| < 3, 
|w~™( fi, (Ww, wt) + fip(wié, w'))| Sny-K~* +26 (A.2.30) 
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where n, is the number of the integer pairs (k,/) with L,(k,1) <0. Choose K, 5 such that 
ngK~* < dA" and 2"*15 < 75”. Then there is a constant C, ,, depending only on A, a, such that 
Ji(fis% S4C,,,. Similarly, J,, (f;,«) S4C, ,. It follows that 


dV 
j fl? = (i, +ji)C, 4 i LS a) (A.2.31) 
D,xD, i 


Put g; = ¢; "g,(e/?z,, e/'z,), then by taking a subsequence, we may assume that lim, ,, g = g. 
Note that g is a sum of f=f, and some monomials },,z\z, with L,(k,l)<0 and 
kk, =i, +i, Yi-1 p18), ifk =k, -1. 


Lemma A.2.3. Let f, g be given as above. Then 


inf {a,(g)} 2 4,(f) (A.2.32) 
xeD, xD, 


Proof. Since f does not contain any monomial z‘: ~ 'z), any composition of g with a translation in 


C? is still a sum of f, and some monomials b,,z4z, with L,(k,1) <0 and kSk,, | Sj, if 
k =k, — 1. Hence, we may take x to be the origin in (A.2.32). Recall 


n(f) 
Sf, = 22k T] (ct + 4,22), i, Si; 
v=1 


Let A’ be the line segment in ON(g) intersecting with the line {x = y} in R? and g,, be the 
polynomial consisting of all monomials b,,z‘ z', of g with (k, 1)e 4’. As above, we can write 


n(g) 
gy = zizk T] (of + Azyy (A.2.33) 
v=1 


Then i,j, Sr(N(f)) = a,(f)* and r(N(g)) S r(N(f)). 
By the proof of Proposition A.1.1,'we have the estimate 
a,(g) 2 min{(i,)~*, 7)" *, r(N (9) *, (P,)-*} (A.2.34) 
Suppose that one of p’,, say p’, for simplicity, is greater than «(f)~ *. By (A.2.32) and the definition 
of g, we have 


n(g) n(f) 
+i LY PLSi tis Y p, S$ 2r(N(P) (A.2.35) 


v=1 v=1 


where the equality holds iff j, = i, + j, ¥"Y} p, = r(N(f)). It follows that j; = 1 and i, 2 j, = 1. 


i 
By local holomorphic transformations at 0, we may further assume that i, = =. 


of 


Ji 
In case j, = 1, we claim that i, =i,. Suppose that i, 2 i, + 1. Note that g contains the 
monomial z'z3 with I’, = j, + i, 5", p|. Then by L,(i,,j, + i, 5", p) < 0, we have 


v=1 
nif) n(9) 
jig t+i2+i, LY py 2iniy + (1 +i, 2 r 
v=1 v=1 
2 ip; > i,0,(f) 
i’, n(f) 
2 i oh ° ° 
at (i +j,+i,¥ r.) 
i, +1 ae 
A contradiction! Thus i, = i,. We define a new local coordinate system (Z,,2,), by setting 
Z, =2, + A\2z?, Z, =z, then 
ya 
Sgl215 22) = (2, — AZ7P2P TT] +A, — 2,22 


v=1 
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If either none of A, is equal to 2’, or some A,, is equal to 2, and i, +j,+) 4 v9 Pv > Py,» the 
function f,(Z,,Z,) has the same properties of f, in (z,,z,). The above arguments shows that 


a,(g)24,(f). If some /,, is equal to 2), i, +j, + , Py Py,» then by the proof of the 
Proposition A.1.1, we have 


%(g) 2 Py,’ 2 a(S) 


The lemma is proved in case j, = 1. The proof of the case j, = 2 is analogous and a little bit 
complicated. We omit the details and make the following remarks. If «,(g) < «,(f), then one can 
choose A, ,..., 4, +0 with k, > k,-, >... >k, 22 such that in local coordinates (Z,, Z,) 
with Z,=z,+)"_,4, zks and Z, = z,, the associated Newton polyhedron N,(g) lies entirely 
outside the triangle D,, defined by %,-axis, X,-axis and the line L’ through (#,(f)~', «,(f)~ ') and 
an integer point (k’, /')in R, x R, with k’ > ao(f)~' and L,(k’, I’) < 0. That is, the polynomial 
g(Z,, Z,) does not contain the monomials z‘ z), with (k, !)¢ D,,. On the other hand, one can easily 
show that the triangle D,. contains strictly more integer points than the triangle D,, defined by 
z,-axis, z,-axis and the line containing 4, does. Moreover, the fact that g(Z,, Z,) does not contain 
z*2z) with (k,1)eD,. imposes sufficiently many independent equations on the coefficients in 
g(Z,, Zz). In particular, it implies that g(z,, z.) = f,(z,, Zz). A contradiction! Therefore, we always 
have «,(g) 2 «,(f). 

Let h be a holomorphic function in U, x € U, we define a quantity y,(h) as follows. If there is 
a local coordinate system such that «,(h) = r(N,(f))~' for the associated Newton polyhedron 
N,(f), we define i, (hz) to be the smaller one of the x-component of the lower endpoint of A and 
the y-component of the upper endpoint of 4, where A is the line segment in N,(f) intersecting 
with {x = y} in R?. Then y,(h) is the infimum of such i, (hz) among all positive local coordinate 
systems such that «,(h) is the remotedness of the associated Newton polyhedron. Otherwise, there 
is a local coordinate system (z,,z,) such that h = zih,(z,,z2) + O((|z,|? + |z2|7)?), where 
h, (0, z,) #0 and p is sufficiently large. Then we define p,(h) = i. 

Now we complete our verification of the assumption in Lemma A.2.1. Obviously, we have 
u,(g) S u,(f) for any xe D, x D, and in case n,(g) = ,(f), for simplicity, say x = 0, then by the 


assumption that g ,, does not have term zk ~' 2! with | > j,, we have a(g) = %&(f) + & where Z is 
a positive number depending only on the upper bound of «,(f)~' and mult,(f). Therefore by 
induction, one can easily see that the assumption in Lemma A.2.1 holds. 

The proof of Proposition 2.1 is completed. 
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Note added in proof 


After submitting this paper, the author found V.N. Karpushkin’s work on uniform estimates of 
oscillatory integrals in R? (J. of Soviet Math., 35, 2809-2826 (1986)). A much simpler proof can be 


given for the main result in Appendix 2 by using this work, in particular, Theorem 3.1 in the above 
reference. 
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On complex manifolds which can be compactified by 
adding finitely many points 


Alan Nadel* 
School of Mathematics, Institute for Advanced Study, Princeton, NJ 08540, USA 


0. Introduction and statement of results 


The following compactification problem arises naturally in attempts to classify 
complex manifolds: Find sufficient conditions under which a given noncompact 
complex manifold can be compactified—i.e. exhibited as a Zariski-open subset of 
a compact complex space or, better yet, a complex projective variety. By considering 
such a problem, one hopes to reduce the study of certain noncompact complex 
manifolds to that of compact ones, which are often easier to handle from the 
perspectives of intersection theory, analysis, and classification. 

The compactification of arithmetic quotients of bounded symmetric domains 
was obtained by Andreotti-Grauert [AG], Satake [Sat], Baily-Borel [BB], and 
Ash-Mumford-Rapoport-Tai [AMRT]. More recently, Siu-Yau [SY], 
Nadel-Tsuji [NT], Mok [M1, M2], Mok-Zhong [MZ], and Yeung [Ye] compac- 
tified complete Kahler manifolds satisfying various curvature (as well as other) 
conditions. In this paper we shall consider the problem of compactifying strictly 
pseudoconcave complex manifolds. The open embedding of strictly pseudoconcave 
complex manifolds into compact complex manifolds was obtained previously in 
[Ros, AT, AS], and the goal of the present paper is to determine when the open 
embedding is actually Zariski-open. Our first result is the following. 


Theorem 0.1 (Main Theorem). Let M be a connected complex manifold of dimension 
m = 3. Assume that 


1. (Strict pseudoconcavity.) There exists a continuous proper map oy: M — [0, 00) 
such that — @ is strictly plurisubharmonic outside of a compact subset of M. 

2. (Moishezon property.) There exist m meromorphic functions f,,...,f, on 
M which are algebraically independent over C. 

3. (Generalized affine-open cover.) M can be covered by Zariski-open sets 
U which are uniformized by Stein manifolds. 
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Then M is biholomorphic to M* — S where M* is a compact complex Moishezon 
space (or equivalently an algebraic space, proper over C [Art]) and S < M* is a finite 
subset. In particular, M admits the structure of an algebraic space and has finite 
topological type. 


It is worth noting that the hypotheses of Theorem 0.1 are purely complex 
analytic in nature (with the possible exception of condition (1), depending on one’s 
terminology), and in particular make no reference to curvature, symmetry, or 
topological type. In this respect, Theorem 0.1 differs from previous compactifica- 
tion results. 


Examples. Complex manifolds satisfying the hypotheses of Theorem 0.1 can 
be constructed as follows. Start off with any complete (i.e. proper over C) ab- 
stract algebraic variety M* possessing at worst isolated singularities and set 
M = M* — Swhere S c M* is any finite subset containing all singularities. Condi- 
tion (2) obviously holds, as does condition (1) since g can be constructed locally 
near each puncture point séS. Finally, condition (3) holds because every abstract 
algebraic variety admits by definition an affine (hence Stein) Zariski-open cover. 

Another type of example is afforded by a complete Kahler manifold of finite 
volume and bounded negative sectional curvature. However, we appropriately 
postpone further discussion of this example until after the statement of Theorem 
0.2 below, where we will be able to deduce quasiprojectivity. 

In Section 5 we shall give a simple construction of a complex manifold M which 
satisfies conditions (1) and (2) of Theorem 0.1 and yet which is not of finite 


topological type; this implies that Theorem 0.1 is sharp in a certain sense. 


Discussion of the Proof. The proof of Theorem 0.1 is rather technical, but follows 
the general line of reasoning introduced in [NT]: Let M be as in the statement 
Theorem 0.1. Because M is strictly pseudoconcave of dimension at least three, it 
embeds as an open subset of a compact complex manifold M [Ros]. As M — M is 
the pluripolar set of — g, it has measure zero in M. However, it is much more 
difficult to show that M is Zariski-open in M, and for this we extend the methods 
of [NT ] involving the L?-Riemann-Roch Theorem and K4hler-Einstein geometry. 
The approach may be described very roughly as follows. Because the algebraic 
dimension of M equals m by assumption, M is Moishezon and is therefore 
bimeromorphically dominated by a projective algebraic manifold. One then finds 
a suitable analytic subvariety V of M such that both M — V and M — V admit 
complete Kahler-Einstein metrics g and g’ respectively. By the Schwarz lemma for 
volume forms it then follows that (g’)” < g" on M — V. On the other hand, by the 
L?-Riemann-Roch Theorem on M — V together with the usual Riemann-Roch 
Theorem on M, jyg" <Jy(g')". Together these two inequalities imply that 
(g')" = g" on M — V, and by the K&hler-Einstein property of the metrics it follows 
that g’ =g on M — V and hence that M—V=M-— VJ. Finally, by “moving 
V around” one concludes that M is Zariski-open in M. Because of the strict 
pseudoconcavity of M, one can blow M — M down to a finite set, and Theorem 0.1 
follows. 
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Variants of the Main Theorem. We present below two alternative formulations of 
Theorem 0.1 which have the advantage over Theorem 0.1 of being sharp: Theorem 
0.2 (resp. Theorem 0.3) gives a precise characterization of those noncompact 
complex manifolds that can be compactified by adding finitely many points and 
that admit quasiprojective (resp. abstract) algebraic structure (see Proposition 0.1 
below). 


Theorem 0.2 (First variant of the Main Theorem). Let M be a connected complex 
manifold of dimension m = 3. Assume that 


1. There exists a continuous proper map gy: M — [0, 00) such that — @ is strictly 
plurisubharmonic outside of a compact subset. 
2. There exists a holomorphic line bundle L over M such that (Jie ,H°(M, L’) 
separates points and forms local coordinates on M. 
3. M can be covered by Zariski-open sets U which are uniformized by Stein 
manifolds. 


Then M is biholomorphic to a quasiprojective variety which can be compactified to an 
algebraic space by adding finitely many points. 


Example. Let M be a complete Kahler manifold of finite volume and bounded 
negative sectional curvature. Assume that dime M 2 3. We will show that M satis- 
fies the three hypotheses of Theorem 0.2. As in [SY] one can use Buseman 
functions to construct the required strictly plurisuperharmonic exhaustion (see also 
the final section of [NT]). Thus M satisfies (1). Since M has negative Ricci 
curvature one can use L? estimates of 4 to show that M satisfies condition (2) with 
L=Kzy. Finally, since any complete simply connected Kahler manifold of 
seminegative sectional curvature is Stein, it follows that the universal cover of M is 
Stein and in particular that (3) holds. Theorem 0.2 now implies that M is bi- 
holomorphic to a quasiprojective variety which can be compactified to a complex 
space by adding finitely many points. We thus recover a strong form of the main 
result of [SY ] in dimension greater than two. 


Theorem 0.3 (Second variant of the Main Theorem). Let M be a connected complex 
manifold of dimension m = 3. Assume that 


1. There exists a continuous proper map g: M — [0, 00) such that — is strictly 
plurisubharmonic outside of a compact subset. 

2. M can be covered by Zariski-open sets U which are uniformized by bounded 
domains of holomorphy in C™. 


Then M is biholomorphic to an abstract algebraic variety which can be compactified 
to an algebraic space by adding finitely many points. 


Proposition 0.1 (The converse). Let M be a smooth quasiprojective (resp. abstract) 
algebraic variety which can be compactified to a compact complex space by adding 
finitely many points. Then M satisfies conditions (1)}{3) of Theorem 0.2 (resp. 
conditions (1) and (2) of Theorem 0.3). 
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Proof. Griffiths [Gri] proved that every (abstract) complex algebraic variety can 
be covered by Zariski-open sets which are uniformized by bounded contractible 
domains of holomorphy. This takes care of condition (2) of Theorem 0.3. Every- 
thing else is clear. QED 


Thus Theorems 0.2 and 0.3 are sharp. 


Acknowledgements. The results in this paper are based on techniques first introduced in [NT ], 
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Finally, I would like to thank the Institute for Advanced Study for its hospitality and financial 
support. 


Conventions. A subvariety of a complex manifold is defined to be a closed analytic 
subset, not necessarily irreducible. An irreducible (possible noncompact) complex 
space is said to be Moishezon iff its algebraic dimension equals its dimension. An 
abstract algebraic variety is defined to be a reduced scheme of finite type over C. 
Unless we specify the contrary, complex manifolds are not assumed connected and 
algebraic varieties are not assumed irreducible. 


This paper is organized as follows: 


Contents 


. Introduction and statement of results 
. Preliminary material 
1.1 Stein manifolds 


1.3 Cusp forms and the uniqueness of algebraic structure on varieties of 
log-general type 
1.4 The Riemann-Roch inequality for the L?-plurigenera of a complete 
K4ahler manifold 
1.5 The relationship between L?-forms and cusp forms 
1.6 The existence of quasiprojective structure on certain Zariski-open subsets of a 
compact complex manifold 
1.7 The open embedding 
. Zariski-local Kahler-Einstein geometry 
. Proof of Theorem 0.1 
. Proof of Theorems 0.2 and 0.3 
. A counterexample 


1. Preliminary material 


In this section we collect various results which will be needed in the proofs of 
Theorems 0.1-0.3. 


1.1. Stein manifolds 


Proposition 1.1. Let M be a connected complex manifold and S < M a nonempty 
closed subset such that M — S is uniformized by a Stein manifold. Suppose that 
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S<VwUV' where V and V’ are analytic subvarieties of M such that V' has 
codimension = 2 in M. Then in fact S c V. 


Proof. Suppose, on the contrary, that S¢ V. Then there exists an open coordinate 
ball U c M — Vsuch that UNS + @. We note that U — V’ is simply connected 
since V’ has codimension = 2. Therefore the inclusion U — V’ c M — § lifts to 
a map into the universal cover of M — S to give a commutative triangle 


(Stein Manifold) 
| covering projection 
U-V'’c M-S 
(2) 


(1) 


According to Lemma 1.1 below, the map (1) extends holomorphically to all of U. 
Therefore the inclusion (2) extends to all of U, which is absurd since SA U + @. 
This contradiction proves the proposition. QED 


Lemma 1.1. Let M be a complex manifold, V < M an analytic subvariety of codi- 
mension = 2, and N a Stein manifold. Then every holomorphic map 


M-V-N 


extends holomorphically to all of M. 


Proof. In the special case N = C” this lemma reduces to the Levi Extension 
Theorem. The general case follows from this special case since every Stein manifold 
can be embedded as a closed submanifold of some C”. QED 


Proposition 1.2. Let M be a Stein manifold and M — M a covering. Then M is Stein 


This result is now classical and is due to K. Stein himself. 


Proposition 1.3. Let M be a Stein manifold and D a reduced effective divisor on M. 
Then M — D is Stein. 


Proof. Let L = [D] be the holomorphic line bundle over M associated to the 
divisor D, and let se H°(M, L) — {0} be a global holomorphic section whose zero 
locus is precisely D. Endow L with a smooth Hermitian metric (along the fibers) 
such that |s| < 1 (pointwise on M). Denote by c, (ZL) the associated curvature form. 
Since M is Stein it admits a smooth strictly plurisubharmonic exhaustion g. After 
replacing g by x(g) where x: R > R is sufficiently convex and increasing, we can 


assume that 60g + c,(L) > 0 (pointwise on M). Then ¢ + log is a strictly 


1 
|s|? 


plurisubharmonic exhaustion of M — D, as desired. As an aside, we remark that 
Docquier and Grauert have proved the more general result that every locally Stein 
open subset of a Stein manifold is Stein. QED 


Proposition 1.4. A given domain Q < C” is a domain of holomorphy iff its universal 
cover QQ is Stein. 
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Proof. On direction follows from Proposition 1.2. For the other direction we 
assume that Q is Stein. A classical result of Oka characterizes domains of holo- 
morphy as those domains which satisfy the Kontinuitatssatz (see [Siu]). But it is 
immediate that Q satisfies the Kontinuitatssatz since its universal cover is 
Stein. QED 


1.2. Moishezon manifolds 


In this subsection we shall present an elementary result concerning divisors on 
Moishezon manifolds. Let M be a compact Moishezon manifold. As is well-known, 
M can be “blown-up” to a smooth complex projective variety. More precisely, 
there exists a holomorphic map f: M’ > M from a smooth projective variety M’ 
and a subvariety C < M of codimension 2 2 such that 


1. The map f induces a biholomorphism M’ — f ~1(C) > M — C. 
2. The fibers f ~'(c) have positive dimension for all ce C. 


Such a subvariety C < M will be called a center for f. 


Proposition 1.5. Let M, M’, C, f be as above, and let pe M — C be a given point. 
Then there exists a reduced effective divisor D on M such that 


1. Cc D, and 
2. p€D. 


Proof. Let D’ be an ample divisor in general position on M’ whose support does 
not contain f ~‘(p), and set D = f (support of D’). Since D’ is in general position, 
D has codimension 1 in M. Clearly (2) holds. As for (1), we note that every fiber 
f~*(©) (ceC) has positive dimension and therefore must intersect every ample 
divisor on M’. QED 


1.3. Cusp forms and the uniqueness of algebraic structure on 
varieties of log-general type 


Let M be a complex manifold and let y ¢ H°(M, K $") be a v-canonical form on 
M for some integer v > 0. 


Definition 1.1. We say that y is a cusp form on M provided that 


[WAdi<a. 
M 


Proposition 1.6. Let M be a complex manifold, D a reduced effective divisor on M, 
and w a cusp form on M — D. Then w extends meromorphically to a pluricanonical 
form on M with strictly less than logarithmic poles along D. 
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A proof can be found in [Sak]. Conversely, we have the following proposition. 


Proposition 1.7. Let M be a complex manifold and let y be a meromorphic section of 
K %” over M. Assume that w has strictly less than logarithmic poles. Then 


Jad ce. 


for any compact subset S of M. 


The proof of this proposition is trivial when the pole set of y has simple normal 
crossings, and one can always reduce to this case by employing Hironaka’s 
resolution of singularities. 

From the above considerations (and GAGA) we deduce the following. On 
a smooth algebraic variety all cusp forms are algebraic. A smooth connected 
algebraic variety of dimension m is of log-general type if and only if its ring of cusp 
forms has transcendence degree m + 1 over C. 


Proposition 1.8. Let U, U’ be smooth quasiprojective varieties of the same dimension 
and let f: U +U’ be a biholomorphism of U onto an open subset (in the classical 
topology) of U’. Assume that U' is of log-general type. Then f is a morphism of 
algebraic varieties. 


Proof. Thus we consider the case of an open inclusion U c U’. To show that this 
inclusion is a morphism of algebraic varieties it is sufficient to show that V’ 4 U is 
an algebraic subvariety of U for every algebraic subvariety V’ of U’. Clearly we 
may assume further that V’ has pure codimension 1. Let y = 0 be a cusp form on 
U’ whose zero set contains V’. Such exists because U’ is of log-general type. Then 


SWAD Ss [UAD* <x 


which implies that the restriction of wy to U is a cusp form on U and hence is 
algebraic on U. Therefore the zero set of y restricts to an algebraic subvariety of U. 
We conclude that V’ 4 U is an algebraic subvariety of U, as desired. QED 


Similarly, we have 


Proposition 1.9. Let U, U’ be smooth algebraic varieties of the same dimension and 
let f: UU’ be a biholomorphism of U onto U’. If either one of U,U’ is of 
log-general type then so is the other, and f is an isomorphism of algebraic varieties. 


1.4. The Riemann-Roch inequality for the L?-plurigenera of a 
complete Kahler manifold 


The following Riemann-Roch inequality for the L?-plurigenera of a complete 
Kahler manifold was proved in [NT] by using a microlocal calculation of 
Demailly. 


Theorem 1.1. Let (M,g) be a complete Kahler manifold with Ricci (g) < — g. Set 
m= dim M. Denote by H?)(M, K%") the vector space of all square integrable 
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(relative to g) holomorphic sections of the v-th tensor power K %” of the canonical 
bundle K,,. Then we have the following estimate: 


1 
lim inf v-™ dim H®,(M, K §") = a fc,(Ky)" , 
vo *“M 


where c,(Ky) = — Ricci(g) is the Chern-Weil form of the canonical bundle Ky 
equipped with the metric induced from w. 


1.5. The relationship between L?-forms and cusp forms 


Proposition 1.10. Let M be a complex manifold of dimension m, D an effective 
reduced divisor on M, and g a complete Kahler metric on M —D such that 
Ricci(g) < — g. Then the volume form g” is integrable over any compact subset of M. 


Proof. By Hironaka’s resolution of singularities we may assume without loss of 
generality that D has simple normal crossings. It is sufficient to show that the 
volume form g” is integrable locally along D. Take a unit polydisc 


A* = {(z',..., 2)eC*: (27/5 1,1sSism} 
in M such that 


1, A" AD = {z' ... 2 = 0}, and 
2. A™A(M — D) = (A*)E x AE: 


Consider the Poincaré metric on (4*)* x 4™~* given explicitly by 





J/-1& d@d' Pg fe. m  dz'@dzi 
2 


oe 2% le log* 12 oe IPP 


We apply the Schwarz lemma to the inclusion ((4*)* x 4"~" gp)  (M — D,g) to 
conclude that g” < (constant) g>. In applying the Schwarz lemma we have used the 
fact that the Ricci curvature of g is bounded from above by a negative constant 
while that of gp is bounded from below by a constant. Since the Poincaré volume 
form is integrable locally along D we are done. QED 


Proposition 1.11. Let M be a complex manifold, D an effective reduced divisor on M, 
and g a complete Kahler metric on M — D such that Ricci(g) < — g. Then 


H?,)(M — D, K&"_p) < H°(M, K&’ @ [D]®"~") . 


(Here the left hand side denotes the space of all holomorphic v-canonical forms on 
M — D which are square integrable relative to g.) 


Proof. Let We H?,,(M — D, K"_p) be given. For any compact subset C of M we 
have 


fwadyr=fivirgn 
Cc Cc 


Sf (lwl? + Ig" <a 
Cc 
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since wy is square integrable and since g” is integrable on compact subsets of M by 
1 


Proposition 1.10. Here we have used the algebraic inequality X¥ < X + 1 (for 
X > 0, v = 1). Since the set C can be made arbitrarily large we see that y extends 
meromorphically to M with strictly less than logarithmic poles along D (Proposi- 
tion 1.6). The proof is complete. QED 


1.6. The existence of quasiprojective structure on certain 
Zariski-open subsets of a compact complex manifold 


The following result is due to Mok and Wong [MW], although we present a proof 
here for the sake of completeness. 


Proposition 1.12. Let M be a compact complex manifold and let U < M be a Zariski 
open subset which is covered by a bounded domain of holomorphy U (in C™ or more 
generally spread over a Stein manifold). Then U is biholomorphic to a unique 
quasiprojective variety of log-general type. 


Remark. We do not require U to be the universal cover of U. 


Proof. By [MY] we know that U admits a complete Kahler-Einstein metric; by 
uniqueness this metric descends to a complete Kahler-Einstein metric 
g = — Ricci(g) on U. By Proposition 1.11 we find that H?,)(U, K#") < {cusp forms 
on U}. Because g has uniformly negative Ricci curvature, we can use L?-estimates 
of 6 to show that 

U H?)(U, K§") 

v=1 
separates the points of U and forms local coordinates on U. Hence the cusp forms 
on U separate the points of U and form local coordinates on U. 


Consider now the holomorphic line bundle L on M defined by L = Ky, ® [D] 
where D is a reduced effective divisor on M whose support is precisely M — U. 
(Since U is uniformized by a Stein manifold it follows that M — U has pure 
codimension | in M.) Then 


() H(M, L®) 


v=1 


separates the points of U and forms local coordinates on U. Because M is compact 
we can employ Noetherian induction (e.g. induction on the dimension of the base 
locus) to find v, such that 


H°(M, L®”) 


separates the points of U and forms local holomorphic coordinates on U. This 
gives rise to a meromorphic map 


M——-P 
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into some (finite dimensional) projective space P. After bimeromorphically modify- 
ing M outside of U we can assume that this map is in fact holomorphic. As a result 
we obtain a holomorphic map f: M > X whose restriction to U is injective and 
immersive, where X is an irreducible complex projective variety of the same 
dimension as M. Moreover, we may assume that X is normal (since M is). Consider 


now the Stein factorization 
we a 
X 


M 
a 

where g has connected fibers, h has finite fibers, and Z is a normal connected 
compact complex space. Since the restriction of f to U is one-to-one, we conclude 
that h has degree one and hence that f has connected fibers. It follows that X is the 
disjoint union of f(U) and f(M — U). By Remmert’s proper mapping theorem, 
{(M — U) is a subvariety of X and we find that f(U) is Zariski open in X. Thus 
f gives a biholomorphism of U onto the quasiprojective variety f(U). This proves 
the existence of quasiprojective structure on U. This quasiprojective structure is 
automatically of log-general type since the cusp forms on U form local coordinates. 
Uniqueness follows from Proposition 1.9. QED 


1.7. The open embedding 


About 25 years ago Rossi [Ros] proved that any strictly pseudoconcave complex 
manifold of dimension at least three can be embedded as an open (in the classical 
topology) subset of a compact complex manifold. (In dimension two the result is 
false.) Variations on Rossi’s theme which deal with open embeddings into projec- 
tive algebraic manifolds (and which also handle the two-dimensional case) were 
later considered by Andreotti-Tomassini [AS] and Andreotti-Siu [AS]. Below we 
present Rossi’s result in a suitable form, while postponing to subsequent sections 
the much more difficult problem of determining when the open embedding is 
actually Zariski-open. 


Theorem 1.2. Let M be a connected complex manifold of dimension m = 3. Assume 
that there exists a continuous proper map ~: M > [0, 00) such that — @ is strictly 
plurisubharmonic outside of a compact set. Then M is (biholomorphic to) an open 
subset of a compact complex manifold M. Moreover, the following statements are 
true: 


1. The set M — M has measure 0 in M. 

2. Every meromorphic function or tensor on M extends meromorphically to M. 

3. Every subvariety of M without 0 or 1-dimensional components extends to 
a subvariety of M. 


Proof. By Richberg’s smoothing lemma [Ric] or [FS, Theorem 8.2 on p. 38] we 
can assume that g is smooth. Then the existence of M is proved in [Ros, AS]. 
Statement (1) follows from the fact that M — M isa pluripolar set (extend ¢ to all 
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of M by defining it to be co on M — M). Statements (2) and (3) follow from the 
strict pseudoconcavity of M and may be regarded as Hartogs-type extension 
theorems; for (2) see [KR, Theorem 7.5 on p. 470] and for (3) see [GR, Corollary 
7 on p. 229]. QED 


2. Zariski-local Kahler-Einstein geometry 


This section forms the technical heart of the paper. Its goal is to give a criterion for 
certain (classically) open subsets of compact complex manifolds to be Zariski-open; 
the main resu!ts are stated in Theorems 2.1 and 2.2 below. The proofs follow the 
general line of reasoning which was introduced in [NT] and in particular make use 
of the following three deep results: (1) The existence of Kahler-Einstein metrics 
[Kob, MY ], (2) The L? Riemann-Roch Inequality [NT ], and (3) The Zariski-local 
uniformization of algebraic varieties by bounded domains of holomorphy [Gri]. In 
hope of avoiding potential confusion in the proofs we shall be careful to distinguish 
between subvarieties of pure codimension 1 and divisors. 


Theorem 2.1. Let M be a smooth complex projective variety and let U < M be an 
open (in the classical topology) subset. Assume the following: 


1. The set M — U has measure 0 in M and contains a subvariety V < M of pure 
codimension 1 which is maximum (among all subvarieties of pure codimension 
1 which are contained in M — U). 
. The universal cover of U is Stein. 
. For every subvariety H < M of pure codimension 1, every integer v > 0, and 
every ye H°(U — H, K®") such that 


fwapy<o 


U 


it follows that w extends meromorphically to a v-canonical form on all of M. 

. For every subvariety H < M of pure codimension 1, if U — H admits a com- 
plete Kahler-Einstein metric g = -— Ricci{g) then it follows that 
vol,(U — H) < ©. 


Then U = M — V. In particular, U is Zariski-open in M. 


Proof. Let V’ < M bea subvariety such that M — V’ is uniformized by a bounded 
domain in C” [Gri]. By applying Hironaka’s resolution of singularities if neces- 
sary, we can assume without loss of generality that VU V’ is the support of 
a divisor D on M with simple normal crossings. Let D’ be a smooth ample divisor 
on M such that 


1. The divisor D + D’ has simple normal crossings. 
2. The divisor Ky, + D + D’ is ample on M. 


Let H = the support of D + D’. 
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Claim 1. U — H is covered by a bounded domain of holomorphy in C”. (This 
domain need not be the universal cover.) 


Proof. Since the universal cover of U — H is Stein (cf. Propositions 1.2 and 1.3), it is 
sufficient to show that U — H is covered by some bounded domain in C™ (Proposi- 
tion 1.4). But this is clear since M — V’ is. 


Claim 2. U — H admits a complete Kahler-Einstein metric g = — Ricci(g) of finite 
volume. 


Proof. Since U — H is covered by a bounded domain of holomorphy, it admits 
a complete Kahler-Einstein metric g = — Ricci(g) [MY] which must be of finite 
volume by hypothesis (4). 


Claim 3. M — H admits a complete K4dhler-Einstein metric g’ = — Ricci(g’) of 
volume (Ky + D + D’)". 


Proof. This follows from [Kob] since Ky + D+ D’ is ample and D + D’ has 
simple normal crossings. 


Claim 4. (g’)" < g” on U — H. 
Proof. This is a consequence of the Schwarz lemma [MY, Ya]. 


Claim 5. 
H?)(U — H, K8" 4) ¢ H°(M, K@" @ [D + D’]®°-") . 


Proof. For any we H?,)(U — H, K®". 4) we have 


fWaw>=flvleg 


U 
Sf (lwl? + 1g” 
u 


<0 


since y is square-integrable and since U — H has finite g-volume. Here we have 
1 


used the simple algebraic inequality Xv < X +1 (for X >0,v2 1). Hence by 
assumption (3) we know that w extends meromorphically to M. Its poles must lie in 
H and must be strictly less than logarithmic since 


[HAD  =fHADr<0@ . 


This proves Claim 5. 
Claim 6. 
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Proof. We have 


1 
3 fg” < lim inf v-" dim H2,)(U — H, K#* 4) (by L?-Riemann-Roch) 
‘U 


vo 


< lim inf v-" dim H®(M, K%’ ®@ [D + D’]®") (by Claim 5) 


vo 


1 
= mre mu + D+ D’)" (by the Riemann-Roch Theorem) 


I ‘\m 
= i 59) 


1 
ne J (g’)" (since M — U has measure 0) . 
“¢ 


Completion of proof. By Claims 4 and 6 it follows that g” = (g')” on U — H and by 
the Kahler-Einstein property of the two metrics it follows that g = g’ on U — H. 
Since g is complete we conclude that U — H = M — H. But V’ and D’ can “move 
around”. More precisely, while choosing V’ and D’ we had enough freedom to 
ensure that any pre-assigned point pe M be disjoint from V’ U(the support of D’). 
It follows that U = M — V. This completes the proof of Theorem 2.1. QED 


Theorem 2.2. Theorem 2.1 remains valid when M is assumed only to be a compact 
Moishezon manifold. 


Proof. Let f: M'—M be a bimeromorphic holomorphic map from a smooth 
complex projective variety M’ as in Proposition 1.5 and let C < M be the corre- 
sponding center. Let H < M be an arbitrary subvariety of pure codimension 1 such 
that H > C. We apply Theorem 2.1 to f~'(U — H) = U — H inside M’ to con- 
clude that f~'(U — H) is Zariski-open in M’. It follows from Remmert’s proper 
mapping theorem that U — H is Zariski-open in M. The complement of U — H in 
M has pure codimension 1 (by Proposition 1.1 since U — H is uniformized by 
a Stein manifold) and is therefore equal to the maximal subvariety of pure 
codimension | which it contains, namely H u V. That is, 


U-H=M-(HvuD). 
It follows in particular that 
M-UcHvD. 


By moving H around (see Proposition 1.5) we conclude that 
M-—-UcCUVJ, 
and by Proposition 1.1 we conclude further that 
M-Uc Vv. 


Since we already have the reverse inclusion we find that M — U = V, as desired. 
This completes the proof of Theorem 2.2. QED 
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3. Proof of Theorem 0.1 


Let M be as in Theorem 0.1 and let M be a connected compact complex manifold 
which contains M as an open subset, as in Theorem 1.2. By assumption M admits 
m = dim M meromorphic functions which are algebraically independent over C; 
these extend meromorphically to M (Theorem 1.2, part 2) and it follows that M is 
Moishezon. 

To complete the proof it suffices to show that M is Zariski-open in M, for then 
M — M can be blown down to finitely many points since M is strictly pseudocon- 
cave. 

Let U be a Zariski-open subset of M which is uniformized by a Stein manifold. 
Since M is the union of such U, it suffices to show that U is Zariski-open in M. For 
this we apply Theorem 2.2. All that remains is to verify the conditions of that 
theorem. We consider each condition in turn. 


Verification of the first condition 


Part A. We note that M — U has measure 0 in M because M — M does (since it is 
a pluripolar set) and so does M — U. 


Part B. We must show that M — U contains a maximum subvariety V (of M ) of 
pure codimension 1. We note that M — M contains a maximum subvariety V’ of 
pure codimension 1 since M is strictly pseudoconcave. We next note that 
U = M — V" where V” is a subvariety of M of pure codimension 1. The reason for 
this is that M — U has pure codimension 1 in M since U is uniformized by a Stein 
manifold (see Proposition 1.1) and that every subvariety of M without 0 or 
1-dimensional components extends to a subvariety of M (see Theorem 1.2, part 3). 
Finally, we set V = V’ UV"; this does the job. 


Verification of the second condition 


There is nothing to verify here since the universal cover of U is Stein by assump- 
tion. 


Verification of the third condition 


Let Hc M be a subvariety. If wy is a cusp form on M — H then w extends 
meromorphically first to M (Proposition 1.6) and finally to M (Theorem 1.2, part 
2). (Here we have lost no generality in assuming that U = M, for U itself is already 
of the form M — H. We apply similar considerations below when we verify the 
fourth condition.) 


Verification of the fourth condition 


Let H<M be a subvariety of pure codimension 1 and suppose that 
g = — Ricci(g) is a complete Kahler-Einstein metric on M — H. We must show 
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that vol,(M) < co. We have 


1 , : : 
=" fg” < lim inf v-™ dim H,)(M — H, K%"_ q) (by L?-Riemann-Roch) 
"M 


vo 


< lim inf v~-" dim H°(M, L®’) 
(by Proposition 1.11, where L = Ky, ®@ [D]) 
<0 


since M is pseudoconcave [And]. This completes the proof of Theorem 0.1. 


4. Proof of Theorems 0.2 and 0.3 


Proof of Theorem 0.2. The proof of Theorem 0.2 is exactly the same as that of 
Theorem 0.1 except that for the open embedding M < M one uses the result of 
Andreotti-Tomassini [AT, AS] rather than the result of Rossi. This allows one to 
assume that M is projective algebraic. 


Proof of Theorem 0.3. Let M be as in Theorem 0.3. First we show that M is 
Moishezon. Let U c M be a Zariski-open subset of M which is uniformized by 
a bounded domain of holomorphy in C™. Then there exists a complete 
Kahler-Einstein metric g = — Ricci(g) on M. Fix any point pe U. Because g has 
uniformly negative Ricci curvature we can use Hérmander’s L?-estimates of 0 to 
find an integer v > 0 together with forms 


Wor Wi.---> Wm € H)(U, K®") 


such that W,. does not vanish at p while w,,...,W,, form a system of local 
holomorphic coordinates centered at p. As these forms are square integrable, they 
extend meromorphically to M (Proposition 1.11) and we obtain meromorphic 
functions 


1 
Yo Wo 


on M which form a system of local holomorphic coordinates at p. It follows that 
M is Moishezon. Now by Theorem 0.1 we can assume that M is a Zariski-open 
subset of a compact complex manifold M. Let @ be the set of all Zariski- 
open subsets of M which are covered by bounded domains of holomorphy in C™ 
(we do not require these to be the universal covers). By assumption @ is a covering 
of M. 


Claim. @ is closed under finite intersection. 


Proof of claim. Suppose that U, U’e@; we must show that U nm U’ is covered by 
a bounded domain of holomorphy in C”. We note that the universal cover of 
U AU’ is Stein because that of U is Stein and because M — U’ has pure codimen- 
sion 1 (cf. Propositions 1.1, 1.2, and 1.3). It is therefore sufficient (by Proposition 
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1.4) to show that Un U'’ is covered by some bounded domain in C”. But this is 
clear since U is. 

Note that every Ue@ is Zariski-open in M (Theorem 1.2, part 3) and hence 
admits the structure of a unique quasiprojective variety of log-general type (Pro- 
position 1.12). Since these quasiprojective structures respect inclusions (Proposi- 
tion 1.8), we can endow M with the structure of an abstract algebraic variety by 
gluing. This completes the proof of Theorem 0.3. 


5. A counterexample 


In this section we present an example of a complex manifold M which satisfies all of 
the conditions of Theorem 0.1 except for condition (3) and which is not of finite 
topological type. It follows that condition (3) is logically independent of the other 
two conditions. 

Fix m = 3 and consider the subset S c C™ given by 


saf(0....0)svse} 


Then S is a countable compact set whose only accumulation point is at the origin. 
Consider now the function n: C" + [— 00, 0) given by 


2 | 
n(z) = |z|? + log|zi+ > a log|z — z,| 
v=1 


1 
where z, = (:. Nepean oes. It is not difficult to check that 7 is continuous (by 
v 


using the Weierstrass M-test, for example), strictly plurisubharmonic (“strictly” 
because of the term |z|?), and that S = n~ !(— oo). (It follows that, in particular, S is 
a pluripolar set.) 

Now consider C” as an open subset of P” in the usual way and let M = P”™ — S. 
Then M satisfies condition (1) of Theorem 0.1 (take @ = — n near S) as well as 
condition (2) (obvious). However, M is not of finite topological type because S is 
infinite. Hence M cannot satisfy condition (3). 

We remark that this example can be easily generalized: replace P” by an 
arbitrary smooth projective variety and S by any countably infinite closed subset 
possessing only finitely many accumulation points. 
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Weak positivity and the stability of certain 
Hilbert points, II 
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Germany 


In the first part of this paper [14] we proved that all points x of the Hilbert scheme 
of v-canonically embedded compact complex manifolds are stable with respect to 
the usual group action and with respect to some invertible sheaf, provided that x is 
a smooth point of H,.,. As explained there, the only reason that we had to restrict 
ourselves to smooth points of H,.,, was our unability to give an affirmative answer 
to “problem 1.10” in [14]. In the second part, we will fill this gap (see 2.9) and 
thereby finish the proof of 


Theorem 0.1. There exists a quasi-projective coarse moduli space M,, for complex 
compact canonically polarized manifolds with Hilbert polynomial h. 


In fact, as in [14] our approach applies to a larger class of moduli problems: 


0.2. Let h(T) be a given polynomial of degree n and .#, the moduli functor of 
complex projective normal irreducible varieties, with at most rational Gorenstein 
singularities and with an ample canonical sheaf w, satisfying h(v) = x(F, w;). If 
n <2 we take .M@, = .M@, and for n = 3 we take .@, to be the subfunctor of %, of 
families f: X + Y with h°(F, w,) > 0 for all singular fibers F of f. For n > 3 we take 
M,, to be the subfunctor of .@, of smooth families. In any case .@, will be a 
separated and bounded moduli functor (see [8], §2 for those notations) and, in fact, 
any subfunctor ./@, of ;, having both properties can be choosen (see § 6). 


Theorem 0.3. For all the moduli functor M,, considered in 0.2 there exists a quasi- 
projective coarse moduli scheme M,,. 


Our result reproves D. Gieseker’s theorem [4] on the existence of quasi- 
projective moduli spaces for surfaces of general type. However, as we point out in 
6.4, the ample sheaf obtained by D. Gieseker is “better” than the one constructed 
here. 

Narasimhan-Simha, Tankeev, Popp, Mumford-Fogarty and Kollar (see [14] 
for the references) have shown the existence of M, as an analytic space. If one does 
not like D. Mumford’s geometric invariant theory [10] one can use instead [8], 2.7, 
together with 5.2 (or 1.18 of [14]) in order to construct an ample sheaf on the 
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analytic moduli space directly. However, this only seems to work at present, if the 
non normal locus of M, is compact. Otherwise this method will show only that the 
normalization of M,, is quasi-projective (see 5.9). 

The methods used to answer “problem 1.10” of [14] in 2.9, are similar to those, 
already employed in §3 of [14], except one, an unpublished theorem on the 
extension of certain locally free sheaves to compactifications, due to Ofer Gabber 
(see 1.4 for the exact statement). After he told me about his result and the spirit of 
his proof, I was able to cook up my own, slightly different and more clumsy version 
(see 1.6) and its proof. 

Those “Extension Theorems” together with a statement on “extensions after 
finite covers” in 1.7 are discussed in §1. In §2 we recall and extend the definition of 
weakly positive sheaves and reformulate “problem 1.10” of [14]. So we have to 
show, that for certain morphisms f,: Xo — Yo the sheaves fo,@x,)y, are weakly 
positive. The usual arguments (see [9], [12] and [14]) are used in §4 to reduce this 
problem to the case v = 1. 

“Weak positivity” is a positivity notation which uses the existence of sections 
(see 2.2), and the only reasonable methods to construct sections are using either 
ampleness criteria or vanishing theorems. Since both are only valid on compact 
manifolds or schemes, it is not too surprising that at some point we have to 
consider compactifications Y of Y and extensions of fo, @y,)y, to coherent sheaves 
on Y. This is done in §3 using the “Extension theorem 1.7” and the “Nilpotent 
Orbit Theorem” of W. Schmid [11]. Unfortunately there are some complications 
due to the fact that we do not only want to consider moduli of non singular 
varieties. Those force us to include the quite technical constructions in the second 
half of §3. 

Once an affirmative answer to “problem 1.10” is established we just have to 
apply the results of [14] to obtain theorem 0.3. Nevertheless we discuss in §6 the 
necessary assumptions a moduli functor .@, has to satisfy in order to get a quasi- 
projective moduli scheme, by using our method. Finally we recall which parts of 
[14] and this paper are necessary to obtain theorem 0.3 in different cases, and we 
make a few remarks on possible generalizations. 

In § 5 we just recall the applications 2.9 has for fiber spaces. We could not resist 
however to formulate the ampleness criterion which, as J. Kollar pointed out, was 
more or less proven in §2 and 4 of [14] but not stated there (see also [8], § 3). 


This paper was written during a sabbatical term which I used to exploit the 
hospitality of the I.H.E.S. at Bures sur Yvette. 


I thank Héléne Esnault for her help and comments during the preparation of this paper. 
Special thanks I owe to Ofer Gabber. Without him, telling me about his extension theorem, 
this paper would not have been written. 


Conventions 


We try to use the usual notations of algebraic geometry (as for example in R. 
Hartshorne’s book on this subject) and those from higher dimensional birational 
geometry (see [9] and [14]). 
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However, all varieties and manifolds are supposed to be defined over the field C 
of complex numbers, and the word “scheme” is used for “schemes, separated and of 
finite type over C”. Locally free sheaves on a scheme are supposed to be of finite 
rank. 

We call i: W) + W a compactification if W is a proper scheme and W, an open 
dense subscheme. If W, is reduced (non singular or quasi-projective) we assume 
that W is reduced (non singular or projective) as well. 

A morphism 6: W’ + W is called birational if there is an open dense subscheme 
W, of W such that Wy = 6~'(W,) is dense in W’ and d|y,: Wo > Wo an iso- 
morphism. The center of 6 is the complement of the largest W, with this property. 
An example is the blowing up of an ideal sheaf J on W, where the center is the 
closed subscheme where J is not invertible. 

We will call 6 a desingularization, if 6 is a projective morphism and W’ non 
singular. 

A morphism 6: W’ + W will be called finite and dominant, if it is finite and if 
each component of W’ is dominant over some component of W. In this case, we 
have an induced diagram 


vw > WwW 
| i 


wv & w 


where W and W’ are the normalizations. We have an inclusion 
6, Ow = Ty, 0,0 % 


and a trace map 1, 6,07 > t, Oy. The induced map 6, Oy. > 1, 0 will be called 
the trace map of 6. 

Finally, a point x€ W is always supposed to be a closed point, if not stated 
otherwise. 

If X is a Cohen Macauley scheme, wy will denote the dualizing sheaf. If 
f:X — Yisa morphism of schemes, Y Gorenstein and X Cohen Macauley, then we 
write Wy)y = @y @f* ay’. 

If f:X — Y is flat and Cohen Macauley or Gorenstein, then w,,y denotes the 
relative dualizing sheaf. 

If X is a non singular scheme we call D a normal crossing divisor if D is a divisor 
on X, X — D,., open and dense in X and if the components of D are non singular 
divisors intersecting transversally. 


§ 1. Extensions of locally free sheaves to compactifications 


1.1. Let us consider a reduced scheme W, and a locally free sheaf F, on Wo. 
Assume that there is a desingularization 69:Wy —- Wo, a non singular com- 
pactification i’: Wy > W’ and a locally free sheaf F’ on W’ with i* F’ = d3 Fp. 


We want to study conditions which imply that ¥’ comes from some com- 
pactification W of W,. More precisely we want to answer 
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Problem 1.2. Does there exist a compactification i: W) + W and a locally free sheaf 
F on W such that for all commutative diagrams of birational morphisms 
5’ 4 
wa Ww — Ws 
6 { | do 
W - Wo 
with W” non singular, one has 6*¥ = 6* ¥"? 
Here we use “=” to indicate an isomorphism of sheaves (unique if W” is 
proper) which coincides over 6’~'(W,) 67 '(Wo) with the one given in 1.1. 


Obviously the answer is no. In fact, the following condition is necessary: 
Condition 1.3. Let C be a non singular curve, Cy an open dense subcurve and 


No:Co + Wo a morphism. Then there exists a locally free sheaf Y on C with 
No* Fo = Fc, such that for all diagrams 


«8 | 50 
Wo 


with t finite, n'(t~'Co) ¢ Wo and o°T|,-1(C4) = 59°’ |--14¢C9), ON€ has 
TG = 1'*F'. 


O. Gabber studied the locally ringed space W* obtained by taking the limit 
over all compactifications W of W,. Then he showed that 1.3 implies that one can 
solve the extension problem locally for W’. Those solutions, however, as he can 
prove, must come from a locally free sheaf F defined on a scheme W which 
compactifies W,). Thereby he obtains: 


Theorem 1.4 (O. Gabber). Problem 1.2 has an affirmative answer if and only if 
condition 1.3 is satisfied. 


For the purpose of this paper we will formulate (in 1.6) and prove a slightly 
different version of this “extension theorem”. We replace 1.3 by asking for the 
existence of compatible extensions of F, to compactifications of non singular 
strata of W,. It will be quite obvious that 1.6 is weaker than O. Gabber’s theorem. 
However, as he pointed out, it is likely that both are equivalent. 

The reader should have the following type of example in mind: assume that for 
all desingularizations 79:Z, + Sy of subschemes Sp of W, the sheaf n§4%_ has a 
“natural” integrable connection. Then, if Z) > Z is a compactification of Z and 
Z — Z,. anormal crossing divisor, 79*¥o has a canonical extension as a locally free 
sheaf Fz on Z (see Deligne [2]). If all the monodromies at the boundary are 
unipotent, the canonical extension will be compatible with pullbacks. Under this 
assumption we want to extend ¥, to some locally free sheaf ¥ which gives the 
canonical extensions on all possible Z. 
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In general, the condition that the monodromies are unipotent is too stong. 
Hence, to include the case of quasi-unipotent monodromies, one could also 
consider generically finite morphisms y9:Z, — S, and ask for unipotent mono- 
dromies, provided the degree of yo is large enough. May be, with this type of 
example in mind, the following definition looks reasonable: 


Definition 1.5. Let Y, be a reduced scheme. 


a) A category 2% of compactifying tripels for Yo is a category of tripels 
Z =(Z, Zo, No), where Z is a non singular proper scheme, Z, the complement of a 
normal crossing divisor in Z and yo: Zp > Yo a proper morphism. The morphisms 


t:Z =(Z,Zo,N0) > Z =(Z, Zo, No) 
in & are supposed to be all morphisms t:Z—Z’ with 1t(Z 9) Z> and 
No° Tlzo = No- 
b) We call a category of compactifying tripels complete, if for all Z = (Z, Zo, mo) in 
# and for all proper morphisms t:Z’ — Z, the tripel 
(Z’,Zy = 1 *(Zo), No = No° T\z) 


belongs to Z if and only if Z’ is non singular and Z’ — Z) a normal crossing 
divisor. 


c) We say that 2% covers Yo, if & is complete and if there are finitely many 
Z® = (Z%, Z, n)e ZF, let’s say for i= 1,...,k, such that 


i) There is an open dense non singular subscheme S of n{?(Z‘?) such that 
nS |-4s):N8 | (S®) > S® is finite. 

ii) Yo = te, S®. 

d) We say that & covers Y, birationally, if we can choose Z,. .. , Z™ such that in 
addition to i) and ii) the morphisms 79) ,«0-+go) are isomorphisms (and hence n{) is a 
desingularization). 


e) Let to: Wy —> Yo be a proper morphism and i: W, > W a compactification. We 
write 2 y for the full subcategory of % consisting of all Z = (Z, Zo, no)€F% for 


which 9:Zo —> Yo factors like Zo * Wo 3 Y, and np is the restriction of some 


morphism n':Z > W. 


f) Let F, be a locally free sheaf on Y,. An extension Y of F, to & consists of a 
sheaf 7 on Z for all Z =(Z,Zo,no)€Z% with n§ Fo = Yz\z, such that for all 
morphisms t:Z — Z’ in Z one has t* G7, = Gz. 


g) Using the notation from e), let F be a locally free sheaf on W with 
i*F =t§F,. Let Y be an extension of Fy to &. Then we say that F is induced 
by & if for all Z€2y and all prolongations n’:Z > W of no:Z> > Wo one has 
n'*F =Gz. 


Again some remark about “ = ” is necessary: in f) and g) it means that we fix an 
isomorphism 73 F 9 = Gz\|z, and i*F = t§F. The equality 4'*F = GY, means that 
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No*i*F = nsF o = Gz\z, is the restriction of n'*F = G7. Remark that, since Z is 
non singular and Z, dense in Z, the isomorphism *F = G, is uniquely deter- 
mined by its restriction to Zo. 


Theorem 1.6. Let W, be a reduced scheme, and Fy be a locally free sheaf on Wy. 
Assume that there exists a category & of compactifying triples and an extension GY of 
Fy to ¥.1f & covers W, birationally, then there exists a compactification i: W,. + W 
and a locally free sheaf F on W such that i*¥ = F, and such that F is induced by G. 


Again, the assumptions made in 1.6 are obviously necessary: if A and W are 
given we can take % to be the category of all compactifying tripels and define Y on 
Ly by GY, = n*F (using the notations from 1.5.g). Before proving 1.6 let us state as 
consequence: 


Theorem 1.7. Let Y, be a reduced scheme and Fy a locally free sheaf on Y). Assume 
that there exists some category ¥ of compactifying tripels for Y) and an extension G 
of Fo to &. If & covers Yo then we can obtain a finite dominant morphism 
To: Wo > Yo and a compactification i: W, > W and a locally free sheaf F¥ on W such 
that 

a) The trace map from to, Ow, to the integral closure O ; , Of Oy, factors over Oy,. 
b) i*t¥ =t$F, and F is induced by G. 


Since the assumption in 1.7 are the same as in 1.6, except of the missing word 
“birationally”, 1.7 is a consequence of 1.6 and of the following lemma: 


Lemma 1.8. Let Y, be a reduced scheme and & a category of compactifying tripels 
which covers Y). Then there exists a finite dominant morphism t): Wo — Yo such that: 


a) The trace map from %,Oyw, to the integral closure 07 of Oy, factors over Oy,. 
b) The category 2’ of all compactifying tripels Z = = (Z, Zo:No) of Wo with 
(Z, Zo, T)°No)EF covers Wg birationally. 


We will prove 1.8 at the end of this section. To prove 1.6 we need the following 
lemma. We remind that all schemes are of finite type over C and separated. 


Lemma 1.9. Let W and W’ be reduced schemes, S a closed subscheme of W, S, an 
open dense subscheme of S and 6: W' — W a desingularization with center in S such 
that 6~'(S) is a divisor. Let T be the closure of 5~'(So) in W' and E an effective 
divisor on W' with EQ T = @. Then we can find a diagram of birational morphisms 


é 


vs WwW’. 
L Ls 
V W 


and a Cartier divisor D on V with: 


i) The centers of o and ¢ lie in S — Sy and 5~ '(S — So) respectively. 

ii) If S’ is the proper transform of S under a, then p is a desingularization with center 
in S’. 

ili) DAS’ = @ and 6*D = &*E. 
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Proof. If f is any morphism we write f’( ) instead of f*( )/torsion. Let us denote 
S — So by C. By assumption 6’/, is invertible, where I, is the ideal sheaf of S, and for 
some effective divisor A with 5(A) < C we can write 6'I, = Ow.( — T — A). We have 
6(E) 1S <C and, since W is non singular outside of S,5(E)\|w_—¢ is a Cartier 
divisor. 

We choose | to be an ideal sheaf such that J coincides with Oy( — 6(E)) on 
W — Cand such that 6’I < Oy.( — E — A). For example, for m > 0 we can choose 
I = Oy( — 6(E)) IZ. The assumptions of 1.7 are compatible with blowing up 
W’, as long as the center lies in 6~'(S — Sg). Therefore we may assume that 
5'I = Oy(—) for some effective divisor £ supported in E + 5~'(C). Con- 
sider the ideal sheaf J=(J,UI)-Oy. We have an inclusion IcJ and 
Im(J > ©,) = Im(/ > @,). 

6'J is invertible outside of 6~'(C) and we can choose ¢:V' > W’ to be any 
blowing up with center in 6~ '(C) such that V’ is non singular and ¢’d’J invertible. 
For some effective divisor [ on V’ supported in e*E + e~'5~'(C) we can write 
e'6'J = Oy. (— e*2 4+ T). 

If 7’ denotes the proper transform of T in V’ we still have 


Im(c'5’'J > O,.) = Im(e*5'Il > O,-) 


and hence I will not meet 7’. Since ¢*6’I, is also contained in «’6’J we have 
e*A+e*T>e*S —IT and, by the choice of J, e*2 >c*E+e*A. Then 
I + e*T => &*E and, since EAT = @ we find I = ¢e*E. 

J and J are both invertible outside of C and we can choose a: V > W to be the 
successive blowing up of J and J. By the universal property of blowing ups we find 
og: V’ > V. Blowing up a little bit more we may assume 1.9, ii to hold true. We have 
an inclusion o’] + o’J and, since both are invertible, oJ = 0,(D’)®o’'l for an 
effective Cartier divisor D’. By construction p*D’ = [ 2 «*E. Since p*D’ does not 
meet the closure T’ of p~'(a~'(Sg)), D’ can not meet the closure S’ of o~ '(Sp). 
Therefore D’ does not meet the singular locus of V and we can choose for D some 
subdivisor of D’. 


Proof of 1.6. We proceed by induction on dim(W,). If dim(W,) = 0 there is 
nothing to show. Let dim( W,) = n. Since ¥ covers W, birationally, it must contain 
some desingularization of each component of W,. Of course, we may assume that 
# is closed under finite disjoint unions and therefore we have: 


a) There is a compactification W of W, and a desingularization 6: W’ + W such 
that W’ = (W’, Wy = 5-'(W4), do = bly, JE Z. Let us write G = Gy. 


If we choose the center S of 6 as small as possible, we may assume that 
So = Sq Wo is the union of finitely many S”, where we use the notation from 1.5, c. 
Therefore, if 2%’ denotes the full subcategory of 2% consisting of all 
Z =(Z,Zo.No)EZF with no(Zo) < So, Z will cover So. Moreover Y induces an 
extension of 6) = Fo|s, to 2’, again denoted by Y. By induction we may assume 
that there exists a compactification S’ of Sy and an extension & of & to S’, which is 
induced by Y restricted to 2’. Blowing up W with centers in S — Sy, we may 
assume that S’ is the closure of Sy in W. 
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Let & be any coherent extension of F, to W. Blowing up Fitting ideals we may 
assume that @ is locally free. Since moreover, after blowing up, W — W, will 
become the exact support of an effective Cartier divisor, we can choose & as large 
as we want. Hence we can obtain: 


b) There exists a locally free sheaf Z on W with Bly, = Fo such that Y c 6*B and 
& < B\s., where, of course, all inclusions coincide with the given isomorphisms 
on Wo. 


Both, a and b are compatible with further blowing ups and we may assume in 
addition: 


c) S = S’ is the closure of Sy in W and 6~ '(S)U6~'(W — W,) is a normal crossing 
divisor. If T denotes the closure of 5~1(So);eq in W’, then 


T =(T, Ty = WoT, no = Solr,)€ 2. 

If we write y = 6|;, then Y; = n*é&. Consider the restriction maps 9:2 > B\s 
and g':6*B + 6*B\,. We define Z’ = yp '(&) and XH = gy’ '(G7). If we write 
again 6'(%’) instead of 6*(f’)/torsion, we have an inclusion 6'(¥’) > #. Since 
G\; = G,, we have a second inclusion Y > #, and both are isomorphisms over 
W,. Replacing W’ by some blowing up, we may assume that 5'(#’) is invertible and 
(by abuse of notations) % as well. Moreover, by construction 

O(B')\7 = H |p = Gr = n*6. 
Therefore we can find some effective divisor E on W’, not meeting T and contained 
in 6~'(S — Sg) such that 
GK > 8'(B)@Oy(E). 


Let us apply Lemma 1.9. Using the notations introduced there, we may assume 
that 6~'o~!(W — W,) is a normal crossing divisor on V’ and that o’(#’) is locally 
free. Then V’ comes from some V’e # and 


Gy = eG < &*0'B' @ p*0,(D) = p*(7B' @ O,(D)). 


After renaming we may replace b by the assumption 
b’) Y is contained in 6*Z%, € = Bl; and Y|, = d* Bl. 


Now let E be the support of 6*4/Y. Again E is a divisor not meeting T. By 1.9, 
again, we can blow up W and W’ such that E will become the pullback of some 
Cartier divisor D on W which is not meeting S. In other words, we can assume that 
for some neighbourhood U of S, the inclusion ¥ > 6*@ is an isomorphism over 
5~*(U). Glueing together Y|y-_ 5-15) and Bly along 6~'(U) — 5" '(S)~ U —S, 
we obtain an extension F of F, to W. By construction 6* F = Y and, since all G, 
are compatible, y*F = G, for all Ze Ly. 


This ends the proof of 1.6. For 1.7 we still have to prove 1.8. Before doing so we 
need some method to enforce the condition a of 1.8: 


Lemma 1.10. Let t: Wj — Yo be a dominant finite morphism of reduced schemes and 
Wo normal. Then there exists a birational morphism n:Wo— W, and a finite 
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morphism Tt): Wo — Yo such that t = t,°n and: 


a) The trace map from t,Oy, to the integral closure 0 ; , Of Oy, factors over Oy,. 
b) If Y, is an open subscheme of Yo, W, =t™ (Y,)" T,:W, > Y; a morphism 
satisfying a) and if t| yw, factors like 


Wi, - WwW, Y, 


then the restriction of to to to ( Y;) factors like t5 1(Y,) > W, 4 Y;. 


Proof. Let us choose ¥ to be the sheaf of all local sections s of t,.0 y, such that the 
traces of all local sections of s-t,O,, lie in Oy,. Then / contains Oy, and is 
obviously an Oy, algebra. contains J:t,Oy, for any ideal sheaf J of Oy, with 
J-O; ¢ Oy,. Therefore the integral closure of is t,0 y,. So we found on / such 
that W, = Specy,() satisfies a. We can replace W Bhd, any larger subalgebra of 
T,Oy,, as long as the trace of all local sections s of W lies in Oy,. Then, if 
T,:W, — Y, is as in b, we can assume that t, Ow, is contained in Wly,. 


Proof of 1.8. Let to: Wo > Yo be any finite morphism and 2” as in 1.8, b. 


a) If & covers Y, then 2’ covers W,. Moreover, if % covers Yo birationally, then 
the same holds for 2’. 


In fact, we just have to choose the generators Z” of & (as defined in 1.5c) such 
that to ‘(S) is non singular. 

If j: Up > Yo is an open subscheme we will write j*% for the category of all 
compactifying — Z’ =(Z’, Zo, No) of Up for which there exists some Z € ¥ with 
Z= aie 0 = No (Up) and no = No|z,. Choosing the generators Z of 2 such that 
Uo = , S® for some t’ we obtain: 


b) If & covers Y, then j*% covers Up. 


Now let Z” be generators of # and let S, be the union of the closures of all S® 
for which n‘? is not birational. We may assume that all Z are varieties, that 


dim(Z) = dim(Z®) =... = dim(Z“) 


and that Sy is the closure of | )j- ,S. Moreover we may assume that C(Z") is a 
Galois extension of C(S). We can find an open affine subscheme Y, of Y, 
containing all general points of components of Y, and of the S® fori =1,...,t. 

We can choose primitive polynomials G;(t) for C(Z) whose coefficients are 
regular functions on Sq Y,. If Y, c A™ is an embedding, those G,(t) lift to some 
F,(t)€ CLx,.. .X_,t]. Let y:B— A™ be a finite Galois cover such that all F,(0) 
for i= 1,...,7 split over C(B) in linear factors. 

Define t, to be the restriction of y to W, = y~'(Y,). Then, by construction, the 
trace map from t,, Ow, maps to Oy,. By Lemma 1.10 we choose t 9: Wy + Yo, where 
W, is the union of the normalizations of the components of Yo in the function fields 
of the components of W,. Let S’ be the closure of an irreducible component of 
to ‘(S) in Wo for ie {1,..., t}. By construction G,(t) will have a root in C(S’) and 
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C(S’) will contain C(Z).Therefore we can find some Ze F, such that 79:Zy > Yo 
factors over a birational map 7o:Z, — S’. We can add those to a generator system 
Z” of &’. As we have seen j’*%’ covers to '(U,) birationally and since we may 
choose a system of generators of 2’ containing those of j'*%’ we have for 2’ a 
generator system Z“” such that dim(Z’) < dim( Y) — U,), whenever n{” is not 
birational. 


§2. Weak positivity, again 


2.1. Let Yo be a reduced quasi-projective scheme, #, an ample invertible sheaf on 
Y,, U an open subscheme of Y) and ¥, a coherent torsion free sheaf on Yo. 

If i:V > Yo is the largest open subscheme such that i*¥, is locally free, we 
define S“(F) =i, S*(i* Fo) and A*( Fo) = i, A" (i* Fg). Recall 


Definition. a) F, is called globally generated by A over U if A is a subspace of 
H°(Yo, Fo) and A @®cOy > Foly surjective. 

b) Fo is called globally generated over U if Fy is globally generated by H°( Y, Fo) 
over U. 

C) Fo is called weakly positive over U if Fo|y is locally free and if for all a > 0 we 
can find some b > 0 such that S*°(F,) @ #5, is globally generated over U. 


The definition of weakly positive is independent of the ample sheaf #, 


choosen. If Fo is locally free on Yo and Yo projective, then “#%_ weakly positive 
over Y,” is the same as “¥, semi-positive” in the sense of Kawamata [5]. 

For technical reasons we want to “bound the poles” of the sections needed in 
2.1, c in order to generate the sheaf over U. May be, one can get along without, but 
in any case it seems to be of interest to keep control, where those sections are 
coming from. Also it seems that this boundedness makes it easier to glue local 
informations together (see 2.11). N. Nakayama gave an example of an invertible 
sheaf, where the boundedness does not follow from the weak positivity. Hence, we 
add it to the definition: 


Definition 2.2. Keeping the notations from 2.1, we will call 4 weakly positive over 
U with respect to ( Y', F') if the following conditions hold: 


i) Y’ is a projective non singular scheme, ¥’ a coherent torsion free sheaf on Y’ 
and Fo|y is locally free. 


ii) Y’ is obtained as a desingularization 6: Y’ > Y of a projective compactification 
J: YY. 
ili) For all y > 0, one has an inclusion 

Pn: S"( Fo) > j* 6,8" F') . 
iv) Given an ample invertible sheaf # on Y and a > 0 we can find some b > 0 such 
that S*°(F,) @j* #° is globally generated over U by 


A = H°(Y,6,S°'(F') @ #”°) 0 HY, S*"(Fo) @j* #”) 
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(Of course, the intersection takes place in H°( Yo, j*6,S°"(F') @j* #”) using 
Pa-b)- 


2.3. Some properties. If j: ¥, > Y is a compactification and n: Y > Y the normaliz- 
ation, we write Ay =j, Oy, n,O;. Hy is an Oy-algebra, quasi-coherent, as the 
intersection of quasi-coherent sheaves, and coherent, as subsheaf of the coherent 
sheaf n, 0 >. 


Let us write ( )** instead of S'( ) for the reflexive hull on Y’. Let Y’ A ¥< Yo 


be as in 2.2 i, ii and let o: Y” > Y’ be a birational morphism with Y” non singular 
and projective. 


a) We can, in 2.2, assume that 7, = Oy. 


b) If oy = Oy and if F_ is weakly positive over U with respect to (Y’, F’), then 
F =j,FoO6,(F '**) is a coherent and torsion free sheaf, weakly positive over U. 


c) If A, is weakly positive over U with respect to (Y”, ¥”), then the same holds 
with respect to (Y’,o,.F"). 


d) If F, is weakly positive over U with respect to (Y’, ¥’), then we can find some 
F" with o,S"(F") = S"(F'). Especially F_ will be weakly positive over U with 
respect to (Y”, F”). 


Proof. For a we just have to replace Y by Specy(.7y). 


In b it is obvious that ¥ is coherent and torsion free. For simplicity we can 
write F’ instead of F’**. For A as in 2.2., iv, we have to show that A ® , maps to 
S*°(F) @® #H”. By abuse of notations we may assume that F is locally free. For 
n > 0 we have, for 6’: Y’ > Y with 6 = nod’, 


S"(n*F) = S"(n*j, Fo 05, F') = n*S"(j,Fo) OS"5,F') . 


Outside of the center of 5’ both, 6,,S"(F ') and S"(6', F ') coincide and we get a map 
from the first sheaf to the second. Then A ® @, maps to 


n,n*S*"(F)@ H”° = S*"(F)@ H#” @n, Oy 
and to 
jyS*?(Fo) @ H” = S*"(F) @ H” @ ji, Oy,- 


Since Wy = Oy we are done. 


c) follows since we have again a natural map 0, S"(F'") > S"(o,F'"). 

For d we choose some effective divisor E in the exceptional locus of o such that 
Oy-( — E) is relatively ample for o. For some p > 0 and ¥” = o*F'/torsion the 
sheaf F "(u- E)|, will be contained in @ O,. Then S"(F "(u- E)) will have the same 
property. Therefore o,(S"(F"(u- E))@ O(v-E)) is for all v>0O the same as 
o,(S"(F "(u: E))). Replacing F” by F”(u- E) we found F”. 


In §3 of [14] and §5 of [9] the reader can find several properties of weakly 
positive sheaves. They carry over, in an obvious way, to “weakly positive with 
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respect to”. In any case, the only non trivial properties we will need are: 


2.4. Let us fix some notations: 
Ye aoe ae 
Fe te by (*) 
Yo ? ¥ - _% 

is supposed to be a commutative diagram with: i and j are projective com- 


pactifications, o and 6 desingularizations and t, is a projective morphism of 
reduced schemes. 


Functorial properties. Assume that F, is locally free in some neighbourhood of the 
non normal locus of Yo. 


a) Assume that the morphism 1, in (*) satisfies: V = to '(U) > U is finite, domi- 
nant and the trace map from To, Oy to the integral closure of Oy factors over Oy. 
Then ¥, is weakly positive over U with respect to (Y’, F’), if t¢F_ is weakly 
positive over V with respect to (Z’, t'* F’). 


b) F_ is weakly positive over U with respect to ( Y’, F’) if for some py > 0 one has: 
For all diagrams ( * ) with t, finite and for all ample invertible sheaves . on Z, the 
sheaf 14F%.@i*J" is weakly positive over t )'(U) with respect to 
(Z',t*F' @ o* f"). 


c) Assume that Y is projective and F locally free on Y, and let 6: Y’> Y be a 
desingularization. Then 6*F¥ is weakly positive over Y’, if and only if F is weakly 
positive over Y with respect to (Y’, 6*F). 


Proof. c) The “with respect to ( Y’, ¥')”, is automatically satisfied if F is known to 
be weakly positive over Y. Hence c is a special case of [14], 3.4 e. However, a simple 
proof is as follows: by [14], 3.4. d, one may assume F¥ to be an invertible sheaf. 
Seshadri’s numerical criterion for ampleness together with [14], 3.2, show that it is 
enough to use the obvious fact, that F is numerically effective if and only if the 
same holds for 6*F. 

a) and b) are nearly the same as [14], 3.4, b and c. The proof uses the same 
arguments. One just has to add, that the trace maps on Y and Y’ are compatible. 
For example, assume that 134%, is weakly positive over V with respect to 
(Z',<'*F'). We may assume by 2.3, a that /, = Oy and moreover that F, is 
locally free. As in 2.3, the sheaf o,t'*F' Ni,t3F_ is weakly positive over V. 

If one chooses # and E and b > 0 as in [14], 3.4, b one finds a map, surjective 
over U, 


@ 1,07 @ H? + S296, 0*F' 1 itkFo) @ H” @ t,07( — bE). 


The trace maps induce a map, surjective over U, from the right hand side to 
S?*°(j, Fo) @ #7?” and another map, compatible with the first one, to 


$?*°(5,F') ® H> : 
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The same argument proves b. 


Later, the reference sheaves ¥’ on Y’ will come from direct images of powers of 
dualizing sheaves. The following “base change lemma”, similar to [12], 3.2, will 
allow to compare different compactifications and desingularizations. 


Lemma 2.5. Let 


Yauge ¥" x» 3’ + ae 
ti \ tn sr 
Sa ip y’ 

p 


be a commutative diagram of proper morphisms between reduced schemes, where 6 is 
birational X", Y", X' and Y’ are non singular, and p' = p,° 6. Let #' be an invertible 
sheaf on X' and L" = p'* #'. Then for v = 1 we have: 


a) If p is birational, then 
f(xy @L’) contains py f(Wyyy@ L"). 
b) If p is finite then 
P* (Li (oxy @ L))** contains (f(y @ L"))** 
Proof. a) is trivial since one has an inclusion Oy., > wy and 


Pe (Oy @ L") = Oey QL". 


b) Let Z’ be the normalization of Z and let X” = Z" ash Z be the factorization of 6. 
Since p is flat, the pullback of a reflexive sheaf under p remains reflexive and, 
leaving out codimension two subschemes of Y’, we may assume that f’ is flat and 
Gorenstein. Then Z will be Gorenstein and wz,)y = p}@y-)y. If wz denotes the 
reflexive hull of the canonical sheaf on the smooth locus, one has 


5, Wz: = KH om(6d, Oz, z) bar Wz 


and a surjection 6’*6,, wz, > wz. Since wz is invertible we obtain wz, > 6’*w, and, 
for some exceptional divisor E of 6” an inclusion w}.' + 6*wz" '(E). Altogether 


5, (Wx @ L") > 5, (5, @y-(E) @ 5* (wz * @ p3 L')) > 
> 5,07 @ wz ' @ p3L’ > 07 @ pif’. 
By flat base change we get 
4 (Dxeyy @ LH") > py. P37 (@x/y @ LZ) = p*(f, (Oxy @ F))- 
Assumptions 2.6. Let 


Xo 


L fo 
Yo 
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be a commutative diagram of morphisms of reduced quasi-projective schemes such 
that: 


a) i and j are compactifications and o and 6 desingularizations. 

b) fand f’ are surjective and X, =f '( Yo). 

c) fo is flat and all fibers of f, are reduced normal varieties of dimension n with at 
most rational Gorenstein singularities. 


Theorem 2.7. We keep the notations and assumptions from 2.6. Let v = 1 be a natural 
number. Assume that one of the following conditions hold: 


ee 

ii) fo is smooth and for some N > 0 the map f< Soe %Xo/rc os Do/¥o is surjective. 

iii) fo.@x4y, is locally free and commutes with arbitrary change for u > 0. Moreover 
SS fo Xo/¥o > OXo/¥o iS surjective for some N > 0. Then fo, ,)y, is weakly positive 
over Yo with respect to (Y’, fy, @yjy:). 


Remarks 2.8. 1. Since the total space of a deformation of rational Gorenstein 
singularities over a smooth base has again rational Gorenstein singularities, the 
assumption 2.6 implies: 

c’) The general fiber of f, is normal, f, is Gorenstein and, if Yj;— Yo is a 
desingularization and W > Yo a non singular finite cover, then Xq xy,Wg is 
normal with at most rational Gorenstein singularities. Moreover, the singular locus 
of Xo Xy,Wo will not contain a whole fiber of pr. 


2. It follows from c’ that for Yj = 5~1(Y5) one has 


, v ‘ait * Vv — J* v 
Sxl y, = PrFOy, ae: ee O* foxoivo « 


Especially the condition iii of 2.2 holds. 


3. It should be possible to replace in theorem 2.7 the condition c of 2.6 by the 
weaker condition c’. 


4. The sheaf fo,@y,,y, is locally free and compatible with arbitrary base change. 
This result, due to Deligne [2], 5.5 in the smooth case, follows from an argument, 
which J. Kollar told me: By “Cohomology and Base Change” we only have to show 
that the sheaves R'fy,wx,/y, are all locally free for all i => 0. As well known one can 
find a complex E” of locally free sheaves on Yo such that for all closed subschemes C 
of Y, and W=X, xy, C the sheaves R'fo,@x,)y, @ Ow are given by the cohomology 
of E* ® ©,. Therefore we may assume Yp to be a curve and, using flat base change, 
we can assume as well that Yo is smooth. Without changing R’ fo,wx,,y, we can 
replace X, by its desingularization and the local freeness follows from [6]. 


5. Using 4 (in fact only in the smooth case) we will show in 4.3 that ii) implies iii). 
Therefore, in the proof of 2.7 we will use base change whenever it is convenient. 


Corollary 2.9. Under the assumptions made in 2.6 assume that, for all fibers F of fo, 
(, is semi-ample and of maximal Kodaira dimension. Then fy, x,y, is weakly positive 
over Yo for v= 1. 
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Proof. If wp is semi-ample then one obtains from the Grauert-Riemenschneider 
vanishing theorem (see also [3], §2) that H'( F, ;) = 0 for i> 0 and v > 1. Then 
fox x,y, 18 compatible with base change. Since fo is flat, the Euler-Poincaré 
characteristic y(@;) is locally constant. As in 2.8,4 this follows since H*(F, w;) is 
given by a complex of locally free sheaves on Yo, restricted to fo(F). Therefore 
fox X,/¥, 18 locally free and compatible with base change for all v = 1. Since w, is 
semi-ample for all fibres the assumption iii) of 2.7 holds true. 


As an intermediate step we will obtain in §4 as well. 


Theorem 2.10. Under the assumptions made in 2.6 let Y' and L, be invertible 
sheaves on X' and XQ respectively. Assume that £o < i*o, #' and that for some 
N > 0 the sheaf #} is globally generated over X4 by H°(X', Z™)AH(Xo, F4). 
Assume moreover that fo,(@x,)y, ®@ Lo) is locally free and compatible with base 
change. Then fo,(@x,jy,® Lo) is weakly positive over Y, with respect to 
(Y.fi(@xy ® L)). 


Lemma 2.11. a) In order to prove 2.7 or 2.10 we may blow up Y’ and X’. 

b) In order to prove 2.10 it is enough to show that each point y€ Yo has an open 
neighbourhood U such that for the restriction h of fy to V=f9*'(U) one has: 
h, (@y;y ® Loly) is weakly positive over U with respect to (Y’, f,(@ xy ® #’)). 


Proof. a) Follows directly from 2.5, a. 


b) Obviously it is enough to show that fo,(@x,/y, ® Lo) is weakly positive over U 
with respect to (Y’,f,(@y/y ® £’)). To this aim let us write Yo =45~'(Yp), 
Xo =o '(X,) and 


V Xo Xo 
| 1% 15, 
U => VY Yo 
for the induced morphisms. Consider as in 2.3 Wy = j,a,0y 06, Oy. 

Ay is a coherent Oy-algebra, isomorphic to My, over U. By 2.4,a and since 
fow(@x,/¥o ® Lo) is locally free and commuting with base change we are allowed to 
blow up Y as long as the center stays in Y — U. Therefore, replacing Y by 
Specy(./y)) we can assume that o/,) = Oy. 

We may also assume that #’| », = of Zo. In fact, if not we replace #’ by the 
largest subsheaf with this property and blow X’ up to make it invertible. 

Since we assume that 2.10 holds for h we know from 2.3, b that 


F= by fy (@x-/y: @ F')n(a jy hy (@yjy ® Lolr) 


is weakly positive over U. Moreover, F coincides with h,(@yjy @ Loly) on U. 
Therefore it is enough to show that j*F is contained in fo,(@x,,y, ®@ Lo). Obvi- 
ously j*F lies in fo,(@x,/y, @ Lo) @ 4, Oy. 

On the other hand, we have a natural map 


Sol, y, @ 05 Lo) > Plr4 (My, , re¥o/Yo ® prt Lo) 





206 E. Viehweg 


and, by assumption, the right hand side is 6$,o,(@x,;y, @ Lo). Therefore we have 
fF SoSe (Oy: Yi, @ 0$ Lo) > foe(@xoivo @ Ho) ® 50.0 y, 
and, since /, = Oy, we are done. 


Remarks 2.12. a) The argument used in 2.11, b shows, how to use “with respect to 
(Y’,f,@ xy)” in 2.7 to extend “weak positivity” to sheaves coming from com- 
pactifications. For example, one gets easily, that under the assumptions made in 
2.6, one also has: 


Let Y, be an open subscheme of Y, containing Y, and f, the restriction of f to 
X, =f7~'(¥,). Assume that one of the following conditions holds true: 
i) f, is flat, Cohen Macauley and f,,@ ,;y, locally free and compatible with base 
change. We have v = 1 and 6, @ -/y:|x, is larger than @ ,/y,. 
li) f, is flat, Gorenstein and f,,wy"y, is locally free and compatible with base change, 
for 4 >0. Moreover, o,@xy\x, is larger than wy'y, and, for some N >0, 
St ft Of, jy, > OX, /y, iS surjective over Xo. 

Then f\«@,)y, is weakly positive over Yo with respect to (Y’,f', @y-/y:). 


b) The assumption that, for v>1, Se foe®Xo/y, Maps surjectively to w¥,/y, in 2.7, or 
the assumption “w, semi ample” in 2.9 can be replaced by some weaker condition 
in case that fj is smooth: 


Assume that there exists an effective divisor Dy on X 9, which has normal crossings 
relative to fy, such that for some N > 0 the following two conditions are satisfied: 


i) For all » > 0 one has 
fol @Xty, @ Ox,(- LU: Do)) = fo. @xayo 
SB foe(@Xo/v0 ® Ox, (—Do))> WX o/¥o ® Ox,( — Do) 


is surjective (or: for all fibres F of f, © O;( — Do|,) is semi ample and of maximal 
Titaka dimension). 


ii) 


In other words, we ask for some very nice “Zariski-decomposition”. The proof 
remains more or less the same. Just, in 2.10 and 3.16-24 one has to replace “#4 
globally generated over X 4 by #3( — Dy) globally generated over Xo, and to work 


with ¥,( — 13 |) instead of Zo. We leave it to the reader to check all details. 


§3. Direct images of dualizing sheaves 


We want to apply 1.6 and 1.7 to construct extensions of direct images of dualizing 
sheaves to certain compactifications. The starting point is: 


Theorem 3.1 (W. Schmid, [11]). Let go:Vo— Wo be a proper surjective smooth 
morphism of non singular schemes such that all fibres are irreducible and of dimension 
n. Let Wy ~ W’ be anon singular compactification such that W' — W, is a normal 
crossing divisor. Assume that the monodromies of R"go, Cy, around the components 
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of W'—W, are unipotent. Let #' be the canonical extension of 
0 = (R"Go.Cy:) @cOw, to W’ (in the sense of Deligne, [2], I, 5.2). Then the 
subbundle Fo = 9o.y.,y, of Ho extends to a subbundle F' of #'. 


Definition 3.2. For go:V4 — W4 as in 3.1, we will call F’ the Schmid extension of 
Joe ®y;w, to W'. Hence, if we say that there exists a Schmid extension this means 
especially that the monodromy condition of 3.1 is satisfied. 


Theorem 3.3 (Y. Kawamata, [5]). Keeping the assumptions and notations from 3.1, 
let V,-—V’' be a non singular compactification and g': V' + W’ a morphism with 
9'\y, = Yo. Then 


a) F' =g', Wy-jw is the Schmid extension of 9o,®yv./w:, 
b) F’ is weakly positive over W’. 


Kawamata’s proof of b in [5] is quite complicated and uses the theory of 
variations of Hodge Structures. The Tankeev-Kollar vanishing theorem, applied to 
products of go with itself, gives a simpler proof of 3.3, b (see [6] or [13] for similar 
arguments). 


3.4. If fo: Xo > Yo is a smooth morphism of reduced schemes, all of whose fibers 
are compact manifolds of dimension n, we can construct a category of com- 
pactifying tripels 2, which covers Yo, and an extension Y of fo,@ ,)y, in the 
following way (see 1.5 for the notations): 


3.5. Let S. be a closed subscheme of Y, and oy: So > So a desingularization. If 
ho: To > So is the pullback of f, and Sy — S’ a compactification such that S’ — So 
is a normal crossing divisor, then the monodromy theorem ([2], III or [11]) says 
that the monodromy of R"h>» Cz; around the components of S’ — So are quasi- 
unipotent. Using for example [5], 18, or [9], 4.5, we find a non singular covering 
t: W’ +S’ such that W, = t~'(S) is the complement of a normal crossing divisor 
and the monodromies of t* R"ho, C7, are unipotent. 

Choose & to be the smallest complete category of compactifying tripels which 
contains all the tripels W’ = (W’, Wo, o9°T|w,;) obtained in this way. 


3.6. In order to construct an extension Y of fo, y,/y, to Z, it is enough to define 
Gy for the generators W’ from 3.5. For those, if go: Vo > Wo is the pullback of fo, 
dos @y.w; has a Schmid-extension 7’ and we define Yy, = F’. In order to extend 
G to & by pullback we need that the Schmid extensions are compatible. 


Lemma 3.7. Under the notations and assumptions of 3.1, let n: Z + W’ be a proper 
morphism of non singular schemes and n~1(W' — W4) anormal crossing divisor. For 
Zo =n ‘(Wo) the morphism pr,: Vo xw;Zo > Zo satisfies again the assumptions 
of 3.1 and n*F' is the Schmid extension of pt2,@v;, xy,Zo/Zo° 


Proof. This is just saying that the unipotency of the monodromy and the canonical 
extension #’ of #% are compatible with pullbacks. 


By 3.7 we can extend Y to & and found the extension asked for. By 1.7 we get: 
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Theorem 3.8. Let fy: Xo — Yo be a smooth morphism of reduced schemes, all of 
whose fibers are compact manifolds of dimension n. Then there exists a dominant finite 
covering tT): W, > Yo, a compactification i: W, > W and a locally free sheaf F¥ on W 
with: 


a) The trace map from to, Ow, to the integral closure O07, of Oy, factors over Oy,. 
b) TS Sos Dxo/¥o — i*F 


c) If 6: W' > W is a desingularization and W, = 6~'(W,) the complement of a 
normal crossing divisor, then 6* F is the Schmid extension, of pr2,®x, x ,, W/W: 


Corollary 3.9. If fy is smooth and v = 1, then fo, wy,)y, is weakly positive over Y, and, 
moreover, theorem 2.7 holds true. 


In fact, 3.9 is a direct consequence of 3.8 and 2.4, a. To keep control of the 
reference sheaf on Y’ one has to use 3.3, b and 2.5. Since the exact formulation is 
repeated in the proof of 3.24, we do not give the details. 


In §4 we will show, that 2.11 and 2.7 can be deduced quite easily from 3.9 if fo is 
smooth. Hence, the reader just interested in moduli of manifolds can skip the rest of 
this paragraph and go to 4.2. 


For the non smooth case we consider fo,(@y,;w, ® Lo) directly, allowing Lo 
to be trivial. To this eh we have to have a closer look to the Schmid extension first: 


3.10. We want to show, that the Schmid extension of go, @y,)w, is compatible with 
the Schmid extension ‘of certain components of the boundary. To this aim, let gj 
and g’: V' > W’ be as in 3.1 and 3.3. We may assume that = g’*(W’ — W5)isa 
normal crossing divisor. Let Z be an irreducible component of W’ — W 4 and 
E =(W’' — W,) — Z. Let I be a component of 2 of multiplicity one in X and 
dominant over Z. Write W', = W' — E, V, =g'"'(W‘,), [9 = Ng'~'(Zo) for 
Zo open in Z, and assume that Z — Z, is a normal crossing divisor. 
Write 


ee ae eee: Fe 
1 9 la {a | a 
WY, 7 W' ©|-— 2 &| Z 
for the corresponding morphisms. 
If R = g'*(Z) — T, we have natural adjunction maps 


eo’ 
9% ®%y:w(—R) — ay O nz 


| n 


Ix Oy yw’ “4 by Onz(RAT) 


Proposition 3.11. Assume that a: 9 > Zo is smooth and that the monodromy of 
R"~'a,C ,, around the components of Z — Zy is unipotent, and that n|z, is an 
isomorphism. Then the image of ® is a, @ nz. 
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Remark 3.12. It is always true that ®’ is surjective, 


Proof of 3.12. The question is local and we may assume therefore that W’ is a 
projective manifold. For an ample invertible sheaf # on W’, the Kollar-Tankeev 
vanishing theorem ([6], see also [3], §3) tells us that 


H°(V', wy (T)@ 9'* #) > A(T, o,® a* #/2) 


is surjective. Since this adjunction map is induced by ®’, and since we can choose 
H as ample as we want, ©’ must be surjective. 


Proof of 3.11. Let us write R = R, + R,, where R, is the sum of the components of 
R which are dominant over Z and R, the others. 

In order to prove 3.11 we can blow up W’ and replace it by finite coverings. In 
fact, since both, g’* wy.,w, and «, @ pz are Schmid extensions, they are compatible 
with pullbacks as well as the surjection, induced by 9, from g', @y w+ |w—(z-zo) to 
Xo F9/Zo° 

By 4.6 of [9] or 6.1 of [12] we can make semi-stable reduction in codimension 
one and, replacing Z,. by some smaller open set, assume that R, is a reduced 
normal crossing divisor. Blowing up we may as well assume that Z) = Z — (ZN E) 
and that g’, is flat. Making semi-stable reduction a second time we can finally 
assume that all components of 2 which are dominant over components of 
W’ — W, are reduced in 2. 

For some b > 0, @ will induce a map 


9's Oy jw( —b-R,)> ay @ nz 


and using ©’, we see that b = 1 is enough. Hence 3.11 follows from 


Claim 3.13. Under the assumptions made above g', @y-;w:( —R2) > 9, @y)w: is an 
isomorphism. 


Proof. Write R, =) 5-; 4,"2,, for wu, >0, and Y= )S_,n,-Z,. Since R, is 
supported in g’~'(E) we have p, < n, for v = 1,..., r. Let M be a number, larger 
than n, forv=1,...,r. 


Since our question is local in W’ we can write Oy.(E + Z) = #™ for some 
invertible sheaf #. Let S be the normalization of the covering, obtained by taking 
the M-th root out of E + Z, and T the normalization of that, obtained by taking 
the M-th root out of 2, where for Y = g', # we write Y™ = O,.(Z) (see 3.14 and 
[9], §4 or [3], 2.7 for this well known construction). 


Let 
T — V' 


denote the induced morphisms. We have ws = p* @y @ #™~' and 


M=! i-d 
wor Govon( [FD 
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Therefore g',t, @7)s contains gi, yw @ Oy. | — |) as a direct sum- 
mand. This remains true if we replace S by some higher cover and T by the 
normalization of the pullback. Since S has at most quotient singularities we may, 
by abuse of notations, assume S to be non singular and 5~'(E + Z) to be a normal 
crossing divisor. Since T has at most rational singularities h, w7,; will again be a 
Schmid extension and hence locally free. Therefore 


del orm @ o-( .. ae *\)) 


is locally free. This sheaf is contained in g', @y-;w: and, since all components of Z, 
dominant over components of W’ — W4, are of multiplicity one, both sheaves must 
be isomorphic. On the other hand, 


‘Ny 2n,—12 py. 
M N=" = by 


M-1 
Therefore ew z | 2 R,. 


3.14. In the proof of 3.13 we used the coverings obtained by taking roots out of 
divisors. Recall: 


Let Z, be a scheme, ¥ an invertible sheaf, D an effective Cartier divisor and 
N > 0. If ZX = O,,(D) and if s is the corresponding section, then we call the flat 
finite morphism 


to: 2; = specs,( @ gs) 42, 
i=0 
the covering obtained by taking the N-th root out of D 


Properties 3.15. Assume that Z, is flat and Gorenstein over some scheme Sy. 


a) Z, is a reduced scheme, flat and Gorenstein over S,), and 


N-1 
ces i 
T0+Z,/So = @ L* @ Wz5/59: 
1= 


b) If Sy = Spec C and if Z, is normal with rational singularities, let us assume that 
&" is generated by some finite dimensional vector space A of global sections and 
that seA is a general section. Then Z, is again normal with at most rational 
Gorenstein singularities. 


Proof. To is flat and Z, reduced. Moreover z,/s, is just the sheaf on Z, corres- 


ponding to the @ *=! Y~' module # om( OD eset L~',02,)5,). TO prove b we 
consider a desingularization 


No:Zyp >Zy and D'=n3D. 


since D was in general position D’ will be non singular. Let Z’, be the covering 
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obtained by taking the N-th root out of D’ and 
ae 
T% 
" i i No 
Z, > Zo 
To 
the induced morphisms. Then Z’, is non singular and 
n= 


as ’ pe * o-i 
TOs M14 Oz, = Nox Tos Oz, = No» ‘S) Ns L* = T. Oz, 
i=0 


gives the normality of Z,. Z, can only have rational singularities since 


N-1 
= f pe * ie 
TO* I 1*®Z; So = Nox TOxZ;/So = Now @ 7: /55 @ 15 Lo" = T..2, 50 « 
i= 


Assumptions 3.16. f: Xo — Yo is supposed to be a flat Gorenstein morphism of 
reduced quasi-projective schemes, #_ an invertible sheaf on Xo, Do an effective 
Cartier divisor and N = 1. Assume that #* = Oy, (Do) where: If N = 1, then Dy 
should be empty. If Dp) = @ then N should be as small as possible. Moreover, Dy 
should not contain any fiber of fo. Assume moreover: 


i) fo.(@x,/y, ® Lo) is locally free and commutes with arbitrary base change 

ii) Let to: X, + Xo be the covering obtained by taking the N-th root out of D, and 
fi =fo° To: X; > Yo. Then all fibers of f, are reduced normal varieties with at most 
rational (Gorenstein) singularities. 


Remarks 3.17. a) If fo is smooth, we can replace ii) by: 

ii’) Do is a normal crossing divisor relative to f, and all components of Dy have a 
multiplicity strictly smaller than N. Let to: X, + Xo be the normalization of the 
covering obtained by taking the N-th root out of Dy. Then all fibers of f; = fo°T 
should be reduced normal varieties. 

b) As in 2.6 it should be enough to ask in ii) or ii’) that f, satisfies the weaker 
assumption c’ from 2.8, 1. 


We have to define some kind of Schmid extension of fo,(@x,/y, ® Zo). To this 
aim (and not just to increase confusion) let us formulate: 


Statement 3.18. There exists a diagram of fiber products 
Pe a a ae 
} Bo | Bo } t 
ee i © 
1 9% 
Wo Yo 
r 
w’ 
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with fy =fo°T, 91=90°Bo, 91 =90°Bo, Mo =U * Lo, My =5'* Mo, 
By = 1’ * Dy and By = 6’* Bo, such that: 


a) To is finite, dominant and the trace map from 7, Ow, to the integral closure of 
Oy, factors over Oy,. 

b) i and i’ are projective compactifications and 6: W’ > W is a desingularization 
such that 6~' (W — W,) is a normal crossing divisor. 

c) There exists an open subscheme W{, of W4 such that W’ — W{ is a normal 
crossing divisor and a desingularization o,: T’, > V’, = g, ‘(W5) which is smooth 
over W\.. 


3.19. Assume that 3.16 holds true and that we have a diagram as in 3.1. Assume 
moreover that the smooth morphism h, = g{|y;°0,: T, > W, satisfies the assu- 
mptions made in 3.1 on the monodromies. Let Y’ be the Schmid extension of 
h,, @7)w, to W’. By assumption the fibers of g/, have rational Gorenstein singulari- 
ties. Therefore the same holds true for the total space V',. If o: T, > V, is any 
desingularization we will have by 3.3, a, and 3.15, a, that Fo = 9o.(@v,;w, © Wo) 
is a direct summand of 


J'1.®v/wi, = (9; 25), OT /w, = G'\w, . 
Therefore we can define: 


Definition 3.20. We say that Fo = go.(@v,;w, @ Mo) has a Schmid extension, if the 
assumptions of 3.18, b and c, and of 3.19 hold true and we call in that case 
F' =G' Oi, Fo the Schmid extension of F 4 (with respect to Bo) 


Properties 3.21. 

i) F’ is locally free and weakly positive over W’. 

ii) F’ is compatible with pullback under dominant morphisms. 

iti) Let V’ be a compactification of Vj and g’: V’ > W’ an extension of go to V’. Let 

o: V" —+V’' be a desingularization, g” = g'°o and op the restriction of o to 
9 =o ‘(Vo). Assume that there exist an effective normal crossing divisor B” and 

an invertible sheaf “” on V” with 


Oy-(B") = M'%, B'\y, = 08 By and M" |p, = 0% My. 


igs i: B” 
dias ® Ge( or ® an ie | |)) 
i=0 
Kr’ ” ” B" ” wy 
and Fo =Ge\ Ov @ AM —| ar |} S92 lOve @ 4") 


Proof. If T’, from 3.19 is choosen large enough, we can take a non singular 
compactification T’ of T’, which is dominating V”. Then, for h’: T’ > W’ the direct 
sum in iii) is nothing but h', w7.,w. (see for example [9], §4 or [3], 2.7), and F’ must 
be the summand for i = 1. Since F’ is a direct summand of 9’ we obtain i) from 3.3, 
b, and ii) from 3.7. 


Corollary 3.22. Let Z be a smooth irreducible divisor.in W' such that Z) = Wo AZ 
is the complement of a normal crossing divisor and let @o be the restriction of gy to 
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0=9o '(Zo)- If Po«(@45/z.@ Mo) has a Schmid extension F 7 to Z, with respect to 
By|4,, then F'|, = F'. 


Proof. Returning to the notations from 3.21, let us consider 
BO! eee 
1B | 
o 


A a yv" a V’ pes A’ 


Le | 9” La’ Le 
Ao OT SE ee ee 


where 4’ is the closure of 4, in V’, A the proper transform of 4’ in V”, ' the proper 
transform of 4 in 7’ and « = p°f. We may assume that 4 + B” is a normal 
crossing divisor and that 8: > A is a desingularization of the covering obtained 
by taking the N-th root out of B”|,. Then IT will be a desingularization of a 
compactification of 4, = g/ ‘(Zo). Write g: 4‘, > Zo for the induced map. F, 
will be a direct summand of a, @,)z. We have a natural map 


. , _s , , Al 
Po: Fw, = 91.9 vi/w, > P1212, = %e Orjzlz0 


which induces an isomorphism 4'|z, > a, @ r)z\|z,- If Zp 0 W, + @ we are done. If 
not, this implies that the assumptions of 3.11 are satisfied and ®, extends to a 
surjection Y’ > a, @ pz, or an isomorphism 4'|, > a, @ r)z- 


Theorem 3.23. Under the assumptions made in 3.16 we can construct a diagram 
satisfying 3.18 and a locally free sheaf F on W such that go.(@y,j)w, @ Mo) has a 
Schmid extension F' with respect to By and F' = 6* F. 


Proof. Of course we can find such a diagram, for example for 2, = id, such that all 
the properties asked for in 3.18 hold true. However, the morphism h, = g/|.°¢, 
will not satisfy the assumption made in 3.1 on the monodromies. Using [5], 18, (see 
also [9], 4.5) we can find some non singular covering of W’ with sufficiently high 
ramification along W’ — W;, such that the monodromy condition holds true over 
this covering. Renaming and using 1.10 to get back W5, we found a diagram 3.18, 
such that 9o,(@y,;w, ® Mo) has a Schmid extension. 

We may repeat this construction for all closed subschemes of Y,. Let 2 be the 
smallest complete category of compactifying tripels, as defined in 1.5, which 
contains all those tripels W’ = (W’, Wy, t)° 69) thereby obtained. Obviously # 
covers Yo. 

By construction we have a Schmid extensions F’ of 9o,(@y,;w,® Mo) to W’ 
(we keep the notation from 3.18, even if we start with a subscheme of Y,). Let us 
denote it by Gy. If t: Z =(Z, Zo, 49) > W’ is a morphism in Z and t: Z > W’ 
dominant, then t*Y w’ is the Schmid extension on Z by 3.21. If t(Z) is a smooth 
irreducible divisor in W’, then the same holds true by 3.22, and, since we can blow 
up W’ to desingularize t(Z), a combination of both steps gives the same result, 
whenever 1(Z) is a divisor. By induction on the dimension of t(Z) we find that 
t*Gy, always is the Schmid extension. Therefore, if we define for Ze %, Gz by 
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pullback, this is well defined and compatible with morphisms in 2. Hence we 
found an extension Y of fo,(@ x,y, @ Lo) to &, as defined in 1.5, f. 

By 1.7 we find a new covering W, of Yo satisfying 3.18, a, a compactification W 
of W, and a locally free sheaf ¥ on W which is induced by Y. Finally, desingulari- 
zing W we will get back the whole diagram asked for in 3.23. 


Corollary 3.24. Under the assumptions made in 3.16, let i: Xy + X and j: Yo > Y be 
compactifications, 6: Y' — Y and ao: X'— X desingularizations and f': X'— Y' a 
morphism induced by fy. Let £’ be an invertible sheaf of X' and D’ an effective divisor 
with L'N = Ox(D’). Assume that #'|5-y,) = 5*(Lo) and D'\5-1y,) = 5* (Do). 
Then fo.(@xo)y,® Lo) is weakly positive over Yo with respect to 
( ris (Wy jy: ® #’)). 


Proof. We may use the diagram 3.18 existing by 3.23, and the compactification V’ 
from 3.21, iii: Moreover we may assume that a) and xz’ induce morphisms 
t: W' > Y' and y: V’ > X’. By 2.11, a, (or better, using the same simple argument) 
we are allowed to blow up Y’ and hence we may assume that the ramification locus 
of tin Y’ is a normal crossing divisor. The normalization Y of Y’ in the function 
ring of W’ need not be non singular, but by [5], 19, (see also [9], 4.7) there is a finite 
non singular covering dominating Y. Replacing W’, V’ etc, by the induced covering 
aid using 1.10 to enforce condition 3.18 a, we may assume that W’ is a de- 
singularization of a non singular finite cover of Y’. 

Since 6* ¥ = F’ is weakly positive over W’ we find by 2.4, c, that F is weakly 
positive over W with respect to gi (yw @ M”), where, in the notations of 3.21, 
iii, “” = o* y* FH’. By 2.5, a and b, and 2.4, a we find fox(@ ,/y, @ Lo) to be weakly 
positive over Y, with respect to (Y’, fi, (x+y. @ #’)). 


§4. Direct images of powers of dualizing sheaves 


We want to prove theorem 2.7. The methods employed are similar to those used in 
[12] (see also [9], §5 and [14] §3). 


4.1. Proof of 2.10. We will use the notations of 2.6 and 2.10. 


Let ye Y, be a given point. Since #} is generated over Xo, by 
A=H°(X', #'%) \ H°(Xo, Z3), we can take a general section of the image of A in 
Ho(fo'(y), Lolz) and lift it to se A. Let Do be the zero divisor of s on Xo and 
X, the covering obtained by taking the N-th root out of Do (see 3.14). By 3.15, b, 


fo P ‘ ‘ ‘ 
the fiber of f,: X,; +X q — Yo over y’ will be a normal variety with rational 


Gorenstein singularities for all y’ in a neighbourhood of y. By 2.11, b we are 
allowed to replace Y, by this neighbourhood. Hence we may assume that the 
assumptions made in 3.16 are all satisfied. By construction, the pullback of Dp 
extends to some divisor D’ on X’ with O,.(D’) = #'%. Then 3.24 implies the 
positivity, asked for in 2.10. 


4.2. For those who did not want to read the constructions 3.10—3.24, we sketch a 
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slightly different proof of 2.10 in the smooth case: 


Let ye Yo be given and, again, f,: X, + Yo the morphism obtained by taking 
the N-th root out of a general section 


se¢H°(X’, £'%) \H(Xo, LX). 


If Do is the zero divisor of S, Dy will be non singular and will meet all fibers over 
some neighbourhood of y transversally. By 2.11,b we can replace Y, by this 
neighbourhood. 

Then however, f;: X;— Yo is smooth. Moreover, fox(@ x,)y, @ Lo) will be 
direct summand of f;«@y,)y,. Hence 3.9 implies that fo.(@ x,y, ® Lo) is weakly 
positive. Since s extends to some section of #’", we can extend the covering X, of 
X to some compactification and obtain 2.10 as stated. 


Corollary 4.3. If fy: Xo— Yo is a smooth morphism and YL, a sheaf such that 
Sx for LX — L' is surjective, for some N > 0, then fo,(@x,/y, ® Lo) is locally free 
and commutes with arbitrary base change. 


Proof. Since the question is local, we can assume that #7} is generated by global 
sections. In the notations from 4.2 fo+(@ x,,y,® Lo) is a direct summand of 
f\+@x,/y,- This sheaf however is locally free and commutes with base change, as it 
was shown in [1], 5.5, and in 28,4. 


4.4. The proof of 2.7. If v = 1 and if fo is smooth, 2.7 has been shown in 3.9. In 


general, for v = 1, 2.7 is a special case of 3.24 (for N = 1 and # = O,,). Therefore, 
let us assume that v > 1. Using the notations from 2.6, we choose # to be an ample 
invertible sheaf on Y, #’ = 6* # and #, =j* #. 

By assumption f$ fo. @%,/y, > ®Xo/¥o iS surjective. Replacing N by some mul- 
tiple we may assume moreover that S°(fy@¥,)y,) >for @%y, is surjective for all 
b > 0, and that v divides N. 

Let us define 


r(u) = Min{s > 0; for ok, )y, ®@ #5" * 
weakly positive over Y, with respect to 
(Lf, O% 7 @ HO" 1)} , 


r(u) is finite. In fact, we just have to use 2.8, 2, and choose some coherent 
extension ¥ of fo«a{,,y, which is contained in 6, f', @4-)y-. Then F @ #” will be 
globally generated for n > 0. We write r = r(N). 

Choose Lo = wk57, @£§ #9" and, for some large divisor E on X’ with 
codimy.(f’(E)) = 2, #’ = wy @f'* #””"-» ®@ O,.(E). For some b sufficiently 
large, 


= Y?( foe @Xo/vo Ox," Oxy” 
will globally generated over Y, by sections lying in 
H(Y', SOF, ah ry @ 7 ™-1)@ sO) 
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Therefore the quotient sheaf 
Sop oh?" @ HE“ V OTM we fo PEM 
is generated over Y, by 
HY (S08?) @ He-Ne), 
If we choose E large enough this vector space is H°(X’, #’°'"). Since 
Sor Lo ® @xo/vo = So OXo/v0 @ “” 


we find, if v divides py, that all assumptions of 2.10 are satisfied for Zp and #’. 
Therefore we obtain: 


Claim 4.5. fo+(@x,/y, ® Lo) =for,y, ® Ho" is weakly positive over Yo 
with respect to (Y’, f, oy @ #”"™~”). 


Claim 4.6. If v divides p, then (r(u)—1)-u—1<r(N) (u—-1). Moreover 
r(N) SN. 


Proof. By the definition of r(u) as a minimum, the sheaf 
Sor ®ko/¥0 ® : siuiie 
will not be weakly positive over Y) with respect to 
(LS. % 7 @ WWM), 


Then however r-( — 1) must be larger than (r(u) — 1)- — 1. Since we assumed 
that v divides N, we obtain r < N. 


Claim 4.7. fo» @,/y, ®@ #5” » is weakly positive over Yo with respect to 
(YS, Oxy @ HC), 
Proof. This for r = r(N) and p = v just following from 4.5 and 4.6. 


The proof of 2.7 ends with the usual argument: 4.7 holds true for all ample 
sheaves # and, since N remains the same for all pullback families, we can apply 
2.4, b, using 2.5, b, to obtain 2.7 from 4.7. 


§5. Applications to fibre spaces 


In [14] we considered two methods to show the quasi-projectivity of moduli 
spaces: one, using “Geometric Invariant Theory” and a second one, which needs 
however the existence of a universal family, and hence applies only to fine moduli 
spaces. Let us recall the second one, in a slightly more general set up. 


Assumptions 5.1. Let 
ee cee 


Lh iy 
; ,) 
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be a commutative diagram of morphisms of reduced irreducible separated analytic 
spaces (we assume, for simplicity, that they are irreducible, even if the same 
arguments work if they are of finite type). Let us assume that: 


a) iandj are open embeddings, X and Y are compact, and o and 6 are desingulariz- 
ations. X — Xq and Y — Yp are supposed to be closed proper analytic subspaces. 


b) fand f’ are surjective and X, =f ~'( Yo). 


Cc) fo is flat and projective and all fibres of fg are reduced normal varieties of 
dimension n with at most rational Gorenstein singularities. 


d) For all fibres F of fo, the sheaf w, is semi-ample and of maximal Kodaira 
dimension. 


e) For all ye Yo, the set {y’€ Yo, f ~'(y’) birational to f ~'(y)} is finite. 


Theorem 5.2. Under the assumptions made in 5.1 write 


Po = det( foray ry)” @ det( fo+@X,/v,)” 
and 


L' = det(f', ox4y.)” @ det(f, o)y-)? - 
Then, for a, b, u, v > 0 the sheaf Ly is globally generated over Y, by 
A=H(Yo, £o) HY’, #') 


and the induced morphism Y,— P(A) is an embedding. (Definition 2.1, a, makes 
perfectly sense for analytic spaces). 


Remarks 5.3. a) The assumption 5.1, d can be replaced by the weaker assumption 
discussed in 2.12, b, provided f, is smooth. 


b) A closer look to the proof of 5.2 should reveal that, even without the assumption 
5.1, e, for some values of a and b, one still finds enough sections to generate 7p over 
Y,, provided that Y, is normal and @y,,y, relatively ample. 


c) Since 5.1, d implies that fo. @,,/y, is locally free and compatible with base change 
(see 2.9), one can choose the numbers v and y in 5.2 in the following way: for all 
fibres F of fy one wants g,: F > P(H°(F, w;)) to be birational and the ideal of 
~,(F) to be generated by homogeneous polynomials of degree yu. Moreover, the 
multiplication map 


S"(H°(F, oF) > H°(F, oF") 


should be surjective. 
In fact, one can find such v, y for a given F, and by base change, the same v, y 
will work for all fibres which are close by. 


Before starting to sketch the proof of 5.2 it is convenient to have the following 
generalization of our Definition 2.2. 


Definition 5.4. Let Y a reduced irreducible analytic space, i: Yy > Y a Zariski open 
dense subspace and 6: Y’ > Y a desingularization. Let Fy be a locally free sheaf on 
Y, and ¥’ a coherent reflexive sheaf on Y’. We call ¥ , weakly positive over Y, with 
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respect to (Y’, F’) if one has: 
i) Fo ci*6, F' 
ii) Let 
Z’ 


a | a | a’ | 


i 6 
Yo — Y’ 


be a commutative diagram, where Z) = a9 '(Yo), Z is projective and o a de- 
singularization. Then a%4%, is weakly positive over Z,) with respect to 
(Z', «'* F’/torsion). 


Remark 5.5. It is likely, that this definition is not the “right” one, if Y is not 
MoiSezon. However, in all cases where we use it, it will turn out later, that Y was 
Moisezon. 


Proof of 5.2. Since by 2.9 the sheaves fo. 4, )y, are locally free and compatible with 
base change, for » > 1, they are weakly positive over Yo with respect to 
(Y’, 4, ©%-y-) by 2.7. Then, if we choose v and p as in 5.3, c, the multiplication map 
S"( foe ®Xo/¥.) ~for@xty, iS surjective and its kernel in ye Yy determines the 
birational equivalence class of f'(y). Moreover, by 2.9, the sheaf fo.w},/y, is 
weakly positive over Y, with respect to ( Y’, f, @y-/y-). One can finish the proof as 
we did for 1.18 in [14]. However, we want to reformulate the principle behind the 
arguments used there. 


In fact, as J. Kollar pointed out, there is hidden in [14] some quite general 
ampleness criterion. It follows from arguments similar to those used in [14], §2 and 
§4, however it was not stated there. We use the pretext of 5.2 to formulate it: 


5.6. For Yo, Yand Y’ asin 5.4 andi=1,...,s, let F‘ be locally free sheaves on 
Y,, F coherent reflexive sheaves on Y’, such that ¥‘) is weakly positive over 
Y,) with respect to (Y’,F). Let r;=rank(F{))=rank(F) and let 
T;: Gl(r;, C) + V; be finite dimensional positive representations ([14] §2 or [8] §3). 
As we did in §2 of [14] we can consider the induced tensor bundles 7;(F'{)) and 
“taking reflexive hulls” 7;(F'). Let Qo be a locally free sheaf on Y,, Q’ a coherent 
reflexive sheaf on Y’ with Qy < i*6, Q’. Moreover, assume we have a surjective 
map 


my: ® TA FY) > Qo 
i=1 


and a map s 
m': ® T(F") > Q' 


i=1 


which are compatible with each other under i* 5, . For ye Yq the kernel of mg in y is 
a k = rank( Wi, T,(F?)) — rank(Q 9) dimensional subspace of ©, TC"). 
For G= x §_, PGi(r;, C) we obtain thereby a G orbit G- y in the Grassmannian 
Gr(k, @i-1 TAC). 
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Ampleness Criterion 5.7. Under the assumptions made in 5.6, assume that for all 
ye Yo the set {y’'€ Yo; G-y =G-y’} is finite and moreover dim(G- y) = dim(G). 
Then, for a,b,,... ,b, > 0, the sheaf £. = det(Qo)" ®@ &_, det( FP)" is globally 
generated over Yo by 


A =H(Yo, £o) HY’, det(Q’¥ @ Wj, det(F’)") 
and the induced morphism Y, — P(A) is an embedding. 


Remark 5.8. a) Obviously the multiplication map considered in the proof of 5.2 
satisfies for s = 1, all the assumptions made in 5.6 and 5.7. 

b) J. Kollar replaced in [8], §3, the descend argument from [14], 2.7 by some kind 
of Nakai-MoiSezon criterion. One advantage is that he obtains b; = 0 in 5.7, the 
disadvantage is that Y) must be compact in his case. 

c) 5.7 holds true without “with respect to (Y’,...)”, in the set up of “weak 
positivity over Y,”. The proof remains the same. 


Sketch of the proof of 5.7. As in 2.3 we may replace Y by Specy(.%,) and assume 
that .o/, = My. Let us write F = 6, F'™ ni, FP and Q = 56, Q’ Ni, Qo. Blow- 
ing up Y we can assume that ¥ and Q are locally free and that the induced map 
m: ® $-,T(F)>Q is surjective. For &;=@"F° we consider 
P,=P(6’)>Y 
P=P, xy... xyP,> Y 


and P) = 2 '( YQ). The maps 2 6,” + Op(1) induce “universal bases” 
s;: ®" pr¥ Op,( —1) > 2* F® 
and 


s s s 


s= Os: B(D"pr¥ Op,(-1)) > Oat F. 
1 


i=1 i=1 i= 
For neéZ, let us denote 


Ss 


s n 
Op(n-r) = (® ptt ©, ) and ¥= 
i=1 


i=1 


If D is the degeneration divisor of s, then Op(D) = 2* det(F) ®@ Op(r). As in 2.6 of 
[14] one obtains: 
The natural inclusion 


p": Oy + 2* Op(n: D) = det(F )" @ Op(n-r) 


splits. 
In fact p is induced by the natural map 


det(F)-! = @ det(F)-! + @ (Q"F”) + @ S(8') = m Opler). 
i=1 i=1 


i=1 


On P we have the induced map 


M: @ prt T(Q"Or( —1) > @ T(n* F) > 2*Q. 
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and M is surjective over P, — D. Let 


h:P, —-D—> Gif k & r4e")) c pM 
i=1 

be the induced map where the right hand inclusion is given by the Plicker 
coordinates. By assumption h is quasi-finite. 

Let t: P’>P be a blowing up with centers outside Py — D, such that 
h' =h oot: P’ + P™ is a morphism, and such that for some a>0 h’* Mpm (a) 
contains an ample sheaf #, isomorphic to h’* Opu (a) over Py — D. Write 
nm’ =not:P’ + Y. 

Since h* Opu (1) = x* (det(Q) @ det(&)s_, T(F)-*) we can find some 
divisor D’, supported in t~ '(D), an effective divisor E, supported in t~'(P — Po), 
and some b;¢Z such that 


n'*(det(Q)" @ © det(F”)") @ Op(D' — E) 
i=1 


is ample. 

The assumptions made on ¥” and ¥$), the choice of Y and 2.3, b imply that 
n'* ¥ is weakly positive over n’~'(Po). Then as in 4.7 of [14] one finds 
Op(t*D) @ &3_, n’* det(FY ' to have the same property. Tensorizing with a 
high power of this sheaf, we can, for b; > 0, force D’ to become effective. Then, 2.7 of 
[14] allows to “descend sections to Y” and to prove 5.7. 


Remark 5.9. Let .@,, be one of the moduli functors considered in 0.2. Then there 
exists an analytic coarse moduli space M7" for .@,,. One can use 5.2 to show that the 
normalization M,; of M4" is quasi-projective: 

In fact, by [8] §2, we know inbetween that over some finite cover Tt): Yo ~ Mj” 
there exists some “universal family” f: X9 > Yo. By 5.2 we find an ample sheaf on 
Yo, which is the pullback of some invertible sheaf on M4". 

However, as long as Mj” is not normal, the property of ampleness is not 
compatible with finite coverings. Therefore, in this way we only obtain: 

a) M,, is quasi-projective 
b) If the non normal locus of M4” is compact, then Mj” is quasi-projective. 


However, the only obstruction to obtain 0.3 from 5.2 seems to be, that we do 
not know whether we can choose to: Yo — Mj" in such a way that the trace map 
from To+@y, has its image in Oy. May be, a closer look to the arguments used in 
[8] §2 would settle this problem. Since [8] only considers compact moduli spaces 
(for more general moduli problems), the assumption made in b holds there. 


§6. Applications to moduli problems 


Fortunately we formulated 1.7, b in [14] as well as its prove in such a way, that 2.9 
implies theorem 0.3. Let us nevertheless make some comments on 0.3, [14] 1.7, b, 
and their proves. 
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The assumptions on the moduli functors ./, in 0.2 are needed in order to have 
“nice Hilbert schemes”. Let us state what we need exactly: 


Assumptions 6.1. Let h( 7) be a polynomial of degree n and ./@;, the moduli functor 
of complex projective normal irreducible varieties F of dimension n with at most 
rational Gorenstein singularities, such that w, is semi-ample, of Kodaira dimen- 
sion n and such that for v > 0 one has h(v) = x(F, @>). 

Let .@, be a subfunctor of .W;, such that for some number v > | one has: 


i) For all Fe.@,(C) the sheaf w} is generated by its global sections and for the 
induced map 9,: F > P(H°(F, w})), the image ~,(F) is normal and birational to F. 


ii) There exists some separated scheme H of finite type over C and a universal 
family h: X — He.M,(H) together with an isomorphism 


®,: P(h, @*z/4) = gill x H 


over H such that (h,®,) is universal, ie. for all f:X + Ye.m@,(Y) and 
py: P(f,,@y)y) = P’~' x Y there is a unique morphism Y > H such that (f, p,) is 
obtained as pullback of (h, ®,). 


iii) The action of G = PGl(r, C) on H obtained by “change of coordinates in P’~ !” 
is proper. 


Let us write A, = det(h, @" 7/4) and r(y) = rank(h, @"y/4). Obviously for all y 
the sheaf /, is G-linearized (see [10] Def. 1.6). Recall that we denote by H(#)* the 


stable points of H with respect to Y and under the G-action (see [10], Def. 1.7 and 
[14], 5.2). 
Then the main result of [14] and of this paper is 


Theorem 6.2. Under the assumptions made in 6.1 one has 


a) For a,b, u > 0 one has H = H(A%., ® A°)°. 
b) There exists a coarse quasi-projective moduli scheme M,, for %,, 
c) A%.,,@ 2° descends for a, b, 4 > 0 to an ample invertible sheaf on M,,. 


Remark 6.3. It seems that, using the assumptions mentioned in 2.12, b, one can as 
well consider ./;, to be the moduli functor of complex projective manifolds F such 


that for some fixed N one finds an invertible semi-ample subsheaf A of w? of 
maximal litaka dimension and 


dim H°(F, A”) = dim H°(F, af) = h(v-N). 


However, one would need that 7 behaves well on % —> H. 


Remark 6.4. If @,, is the moduli functor of curves or surfaces of general type, then 
D. Mumford [10] and D. Gieseker [4] proved 6.2. However, they were able to take 


r(v- pm): 
b= — hE it a. Since the sheaf correspondimg to /, is weakly positive over M, 


r(v) 


their result implies ours for n < 2, but not vice versa. 
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Some remarks on the proof of 2.9 and on the proof of “2.9 = 6.2” in [14], §5: 


6.5. The starting point is 2.9. If .@, is the moduli functor of canonically polarized 
manifolds with Hilbert polynomial h, then 2.9 is just needed for smooth morphisms 
fo: Xo > Yo. In this case the part “3.10-4.1” of this paper is unnecessary. 

If .M@,, is the moduli functor of surfaces of general type, then again it would be 
sufficient to know 2.9 for smooth morphisms, provided that for all families 
fo: Xo > Yoe-M,( Yo) of normal surfaces with rational double points, one has 
“simultaneous resolution”. That means that one can find t9: Xo > Xo such that all 
fibres of f =fo°T > are minimal desingularizations of the corresponding fibres of 
fo. However, I do not know whether this can be done. 


6.6. The second part, “how to use 2.9 in order to get 6.2” is completely contained in 
§5 of [14]. The proof given there uses only in 5.9 the special structure of the 
universal family and the prove of 5.9 in 5.14 of [14] works as well and without any 
change under the assumptions of 6.2. The sections §2-§4 of [14] are no longer 
necessary in the proof of 6.2. The properties, recalled in 2.4, and 2.9 are enough. 


Comments and open problems 


6.7. It might be possible to extend the results of this paper to moduli problems of 
multicanonically polarized varieties with canonically singularities, at least if one 
has a reasonable Hilbert scheme and if one knows that any deformation of those 
objects over a non singular base has canonical singularities in the total space. We 
leave it to the reader to estimate the technical difficulties one could run into, trying 
to generalize §3 to this case. 


6.8. In principle the methods from [14] together with 2.10 should enable us to 
construct quasi-projective moduli spaces for arbitrary polarized compact complex 
manifolds, let us say with trivial Pic®. However one has to find a natural polar- 
ization # on the total space X for all f: X + Ye.M@,(Y), such that f, is weakly 
positive over Y. Since # is only determined up to f *(Pic( Y)) we can always force 
f, £ to be weakly positive, however in order to apply the methods from §5 of [14] 
we have to do it in a functorial way. It seems that this can be done and we hope to 
be able to use this construction to prove in a third part of this paper the existence of 
quasi-projective moduli schemes for bounded and separated moduli functors of 
polarized normal varieties with rational Gorenstein singularities and irregularity 
zero, whose canonical sheaves are numerically effective. 


6.9. And what about moduli of vector bundles? Again the problem seems to be to 
find a good universal bundle to start with. The only case I know, where an 
approach similar to [14] was applied successfully, is J. Kollar’s proof of the 
projectivity of the compactified Picard scheme in [8], §6. May be, his construction 
of a rigidification of the Poincaré bundle and his method to apply the ampleness 
criterion [8], 3.9 (see also 5.7) could give some hint, how to attack moduli of vector 
bundles. 
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6.10. As the reader has seen, we needed at some point some extension of the 
sheaves considered to a compactification, because 2.4, c, was the only way to 
descend “weak positivity” to singular varieties. It would have been more natural to 
this aim, to look for “good compactifications of morphisms” instead of “Schmid 
extensions” of direct images of dualizing sheaves. May be, one can use methods 
from §1 to construct those. 


6.11. Of course, the existence of good compactifications of morphisms would also 
follow from compactifications of the moduli functors ./,. Since in Theorem 0.3 and 
6.2 we even know that the sections of 4%., ® 4° which embedd M, in a projective 
space are coming from some compactification of a desingularization H, it seems 
possible that some of the methods used in this paper could be of some help, if one 
wants to construct compactifications ./, of M,. 
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1. Introduction 


In this paper we study the group of points modulo p of elliptic curves defined over 
Q. In particular, we are interested in the frequency with which this group is cyclic 
and with which it is generated by a fixed set of global rational points. Let E be an 
elliptic curve over Q and for each prime p where E has good reduction, let E( F,) be 
the group of rational points on the reduction of E modulo p. In [14], Serre raised 
the question of how often this group is cyclic, and following Hooley’s work [6] on 
Artin’s primitive root conjecture, showed that the number of such p< x is 
~ cx/log x for some constant c, assuming the Generalized Riemann Hypothesis 
(GRH). The second author removed this hypothesis for curves with complex 
multiplication (CM) in [9], and also demonstrated unconditionally the existence of 
infinitely many primes for which E(F,) is cyclic in [10], for certain non-CM elliptic 
curves. Though the method of [9] establishes an asymptotic formula, the method of 
[10] does not give a good lower bound for the number of such primes. We will 
prove unconditionally: 


Theorem 1. The group E(F,) is cyclic for infinitely many p if and only if E has a non- 
rational 2-division point, and moreover, in this case, the number of primes p < x for 
which E(F,) is cyclic is > x/log? x. 


The proof of this result is given in section 2; the key is a result from the theory of 
sieves. 

In [3] we discussed the following question, raised by Lang and Trotter [8]: 
Given a rational point X of infinite order in the Mordell-Weil group E(Q), how 
often does the reduction of X mod p equal the full group E(F,)? This question is 
analogous to the classical question of how often a given integer is a primitive root 
mod p, but the situation cannot be handled by Hooley’s method, owing to the large 
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size of the conjugacy classes. However, if E has CM by the ring of integers of the 
imaginary quadratic field k, the authors were able to prove in [3] that the set of 
primes p such that E(F,) = <X > and p splits in k has a density. This method does 
not apply to primes which are inert in k, and we must consider the following 
somewhat weaker question, also raised in [8]. 

Let I be a free subgroup of E(Q) of rank r(I°) and define 


S() = {p prime|E(F,) =I} , 
where I’, is the reduction of I mod p. Also, if E has CM by k, let 
Sl) = {p prime|E(F,) = I, and p is inert in k} . 


One expects the sets S(I) and S’(I) to have certain densities 6(I’) and 6’(I) (see 
sections 4 and 5). Provided r(I) is sufficiently large, one can verify these expecta- 
tions under the assumption of the GRH (see [3]). The ranks for which our results 
apply can be lowered substantially by not insisting on producing the full densities 
above but rather positive multiples of them. Such results were previously known 
(see [3]) only for CM curves with r(’) = 10 and non-CM curves with r(I) = 18. 


Theorem 2. If E has CM and r(I) = 2, then, under the GRH, S'(I’) contains a set of 
density = (1 — log 2 — «)d6'(I) for any e>0 


Theorem 3. If E has CM and r(I’) = 6, then, under the GRH, S(T) has density 5(I). 


Theorem 4. If E does not have CM and r(I’) = 7, then, under the GRH, for every 
é > 0, S(T) contains a set of density 


(1 — log(20/9) — e)d(T) , 
and if we assume Artin’s holomorphy conjecture, then S(I’) contains a set of density 
(1 — log(4/3) — e)d(L) . 


The holomorphy conjecture referred to above is the statement that all Artin L- 
series of the extensions L,,/Q are analytic at s + 1, where the fields L, are as defined 
in section 3. Theorems 2 and 3 rely on the improved error estimate in the 
Chebotarev density theorem of [12], and this improvement is conditional on 
Artin’s holomorphy conjecture. Section 3 is devoted to showing that this holds for 
curves with CM. In section 4 we give the proofs of Theorems 2 and 3, and in section 
5 we prove theorem 4. 


2. Cyclicity of E(F,) 


We let E be a fixed elliptic curve over Q, and let K, = Q(E[n]) for each positive 
integer n, where E[n] is the set of n-division points of E. If p is a prime of good 
reduction, it is easy to see that for any prime q, (Z/qZ)* < E(F,) if and only if p 
splits completely in K,. This gives: 


Lemma 1. If p is a prime of good reduction, E(F,) is cyclic if and only if p does not 
split completely in K, for any prime q. 
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On the GRH, primes which do not split completely in any K, can be suc- 
cessfully enumerated, and an inclusion-exclusion argument leads to the following 
result due to Serre [14] (see also [9]). 


Theorem. Assuming GRH, the primes p for which E(F,) is cyclic have density 
d= dX u(n)/[K,:Q], 


where p(n) denotes the Mobius function. 
We recall that Serre [13] has shown that for E without CM, 
[K,:Q]=|GL,(Z/nZ)| , 
and if E has CM by @,, then 
[K,:Q]=<|(O,/nO,)"\ , 


so that the infinite sum above converges absolutely. 
If any of the fields K, for q prime is trivial, then clearly 6 = 0, and by the 
following well-known fact, this can only happen for q = 2. 


Lemma 2. The cyclotomic field Q(¢,,) is contained in K,, for any n. 


Proof. This follows from properties of the Weil pairing e,, a non-degenerate 
bilinear pairing e,:E[n] x E[n] — y,, where p, is the group of n-th roots of unity. 
The non-degeneracy of e, gives its surjectivity, and its Galois invariance means that 
its image is contained in K,,. See [16, Cor 8.1.1 p. 98] for details. 


One can show that 6 vanishes exactly when K, = Q, and this gives in particular 
the infinitude of the set of primes p for which E(F,) is cyclic if K, + Q, on GRH. 
The key to eliminating GRH in Theorem 1 is the following lemma from sieve 
theory. 


Lemma 3. Let S,(x) be the set of primes p < x such that all odd prime divisors of 
p — lare distinct and = x'!**®, p does not split completely in the field K,, and E has 
good reduction at p. Then if K, + Q there is an > 0 such that |S,(x)| > x/log? x. 


Proof. Since K , contains a non-trivial abelian extension of Q if it is non-trivial (it is 
the splitting field of a cubic polynomial), the restriction that p not split completely 
in K, can be insured by imposing a congruence condition on p. This condition can 
be added to the lower bound sieve of, for example, Fouvry and Iwaniec [1] (see 
[2], [5]) to give the desired lower bound. 


Proof of Theorem 1. Fix an ¢ satisfying Lemma 3 and define 
S(a, x) = {peS,(x)|a, = a} 


for each integer a with |a| < 2x!/, where a, denotes the trace of the Frobenius of E 
at p. By Weil’s Theorem, S,(x) is the (disjoint) union of these S(a, x). Now for each 
S(a, x), we enumerate those pe S(a, x) for which E(F,) is not cyclic. Indeed, if E(F,) 
is not cyclic, then (Z/qZ)* < E(F,) for some prime gq, and by Lemma | and the 
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definition of S,(x), q is odd and p splits completely in K,. By Lemma 2, p also splits 
completely in Q(¢,), so we have p = 1 mod q, i.e. 


get. (1) 


Moreover, |E(F,)| = p + 1 — a, so q?|p + 1 — a and thus q|a — 2. Notice that a 
cannot equal 2 since then q? would divide p — 1. Now by (1), gq = x'/*** and since 
|a — 2| < x'/?,q is determined by a, for x sufficiently large. Any peS(a, x) for 
which E(F,) is not cyclic satisfies 


p=a—1mod q? 
and the number of such p is 


< x/q? + O(1) < xt/?-. 


The total number of peS,(x) for which E(F,) is not cyclic is therefore 


< x1/2-28y1/2 = o(x/log? x) , 


and this completes the proof. 


3. Some group-theoretic preliminaries 


Throughout this section we assume that E has CM by the ring of integers of k and 
let I be a free subgroup of E(Q) of rank r(I). For each positive integer n = 3, let 
L, = Q(E[n], 41°), a Galois extension of Q with Galois group over @ equal to a 
semidirect product of a subgroup of GL,(Z/nZ) and a subgroup of E[n]’""”. Also, 
set L, = kQ(E[2], 41°) and G, = Gal(L,/Q); note that by Lemma 6 of [9], k < L, 
for all n. In this section we will prove the following key fact for the proof of 
Theorems 2 and 3. 


Proposition 1. Artin’s holomorphy conjecture holds for the extensions L,/Q. 


Before proving this, we need some preliminary facts about characters of 
semidirect products. Let A and H be two subgroups of a finite group G and suppose 
that A is normal and G = AH with Ac H = 1. That is, G is a semidirect product of 
H by A. Suppose in addition that A is abelian. In such a situation, it is classical 
knowledge that all the irreducible representations of G can be constructed from 
those of H (see e.g. Serre [15]). 

Indeed, if y is a character of A and he H, define x" by 


x"(a) = x(h-*ah). 


Then y’ is a character of A and this gives an action of H on the character group of A 
(which is isomorphic to A since A is abelian). Let H, be the stabilizer of y and 
extend x to G, = AH, by defining Z(ah) = x(a). Then is still a one-dimensional 
character of G,. Now let p be any irreducible representation of H,; we can view p as 
a representation of G, by factoring through A. Set 


Pi» = Indé (Z ® p) : 
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An easy computation shows that (W, ,,W,,,) = 1 and therefore w, , is irreducible. 
Moreover, all irreducible representations of G arise as one of these. 


Proof of Proposition 1. We suppose that n = 3, but the same argument as below, 
with minor modifications, works for L, as well. Let K, = Q(E[n]) and denote by 
M the Galois group of K,/Q. Let H be the Galois group of L,/K, and write G for 
the Galois group of L,/Q. Every irreducible character of G is obtained as follows. 
Take yeH, the character group of H, which we know is abelian. Then if 
G, = HM,, every irreducible representation is of the form 


Vy.p = Indg (7p). 


Suppose that M, is not abelian (for otherwise, the L-series attached to w,,, is 
entire). Let My = Gal(K/k) where k is the CM field of E; we know that Mg is 
abelian. Then we have an exact sequence 


1+>M,>M->{+1}-1 


and as M, c M and M, is not abelian, there is an element o,¢M, such that 
o,++ — 1. We can view elements of M as ordered pairs (t,o) where t = + 1 and 
aé€M,. With this notation, write o, = (— 1, ¢). Then 


o? =(— 1,e)(—1,e)=(1, —e+ 8) =(1,0). 
If ge M, c M, then g = (t, mg). If t = 1, then ge Mo. Ift = —1, 
go, =(— 1,mp)( — 1, e) = (1, —e€ + mo)EM, Mo. 


Hence every element of M, can be written as (M, 0 M,)t’, j = 0 or 1. We have an 
exact sequence 


1+M,OM,>M,>{+1}->1. 
Thus, p can be written as 
= Ind w 
for some abelian character w of a subgroup M{ c M,. Since 


(7 HM 
Ind}: o= Ind jin: ow 
we have 


£@ Indiv: o = Indi: (© ® Zlum:) 


by Frobenius reciprocity. Therefore, every sneeduality representation of G is of the 
form 


Indg (%@ p) = Indg (Ind¢: (w @ X)) = Indé, (w@ X) 


where G, = HM‘. Thus every character of G is monomial and Artin’s conjecture 
holds. 


4. Generation of E(F,) in the CM case 


We keep the notation and assumptions of section 3 and set G, = Gal(L,/Q). We 
were able to show in [3] that if I has rank 1, the reduction of I generates the group 
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E(F,) for a density « of primes p which split in k, on the GRH. The argument 
follows Hooley’s [6] once one notes that the condition “gq divides the index of I in 
E(F,)” can be expressed in terms of the splitting completely of a prime x in k above 
p in certain extensions of k. The number of these primes can be sufficiently well 
estimated using the result of Lagarias and Odlyzko [7] to prove that they have a 
density. This method falls through if p is inert in k since the divisibility condition 
can no longer be expressed in terms of a “splitting completely” criterion, and the 
enumeration of primes for which it holds becomes worse. We are no longer able to 
deal with the case where the subgroup I of E(F,) has rank one, but can handle the 
case r(I’) = 2. 

If q is a prime and p/ Aq, where A is the discriminant of E, then one can show 
that if [,, denotes the reduction of I mod p, q|[E(F,):I',] if and only if o,(p) < C,, 
where o,(p) denotes the Frobenius symbol of p in the extension L,/Q (a conjugacy 
class of G,), and C, is a certain subset of G, which is closed under conjugation 
(see [3], p. 35). If p is a prime of good reduction which is inert in k, so that 
|E(F,)|=p+1, then q|[E(F,):,] if and only if o,(p)<C,, where 
C, = {ae€C,|o|, = — 1}. For our purposes, the important fact about these objects 
is: 


Lemma 4. The size of G, is = q*"“*? and the sizes of C, and C’, are = q™“*?. 


Proof. This is proved in [3], p. 35 for G, and C,, and the same argument applies 
to Cj. 

For any n, let C,, (respectively C’,) be the set of elements of G,, whose restriction 
to L, lies in C, (respectively C;) for all q|n; C, and C;, are also closed under 


conjugation. Then an inclusion-exclusion makes it reasonable to expect that the 
primes for which E(F,,) = I’, have density 


ny (Gal 
o(T) = 

Gal’ 
and indeed, such a result was sie in ne under the assumption of the GRH, 


provided r(I’) = 10. Also, we expect S’(I’) to have density 


IC;,| 
o(r 
(r)= ¥ wl) Gr 
In order to enumerate the sets S(I”) and S’(I’), we will need the following estimates 
for the error term in the Chebotarev density theorem. 


Proposition 2. Let L/K be a Galois extension with Galois group G, and C < G be 
closed under conjugation, and assume the GRH. Define 


Tc(x) = |{p a prime of K unramified in L|Normg gp < x and Frob;,)x(p) < C}| . 


Let dx (resp. d,) be the absolute value of the discriminant of K (resp. L), nx = [K:Q], 
n, = [L:Q], n=[L:K], and P(L/K) be the set of rational primes lying under the 
primes of K which ramify in L. Then 


IG| |G| 


T(x) = ICI lix+ (ict x?/? (log d, + n, log “)), 
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and if Artin’s holomorphy conjecture holds for L/K, then 


¢ 
nets) = 1h thx + 0( ICH 2x" tog( nd I] p)x)). 
| pe P(L/K) 


Proof. The first assertion is due to Lagarias and Odlyzko [7], and the second is due 
to Murty, Murty, and Saradha [12]. 


A key ingredient in the proof of Theorems 2 and 3 is the following lemma. 
Lemma 5. Let 
T(x) = |{p S x|o,(p)EC,}| . 
Then, under GRH, we have 
IC,,| 


Ty (X) = IG, | 


lix + O(|C;,|'/?x?/? log nx) . 


Proof. Artin’s holomorphy conjecture holds for the extension L,/Q by Proposition 
1. Therefore, by Proposition 2, 


Ten(X) = 1Cal lix+ 0 ical?" tog( 2,:0( I] p)x)) ; 
IG,,| pe P(L,/Q) 


and this gives the desired result since [L,:Q] < n?"“*? and only the primes of bad 
reduction and those dividing n can ramify in L,,. 


Proof of Theorem 2. Let 
N(x) = |{p S$ x|peS'(T)}I; 


we want to show N(x) = (1 — log 2 — «)6’(I). Following [3], we introduce the 
notation: N(x, y) = |S(x, y)|, where 


S(x, y) = {p S x|p is inert in k and o,(p)¢C, for any q < y}, 
and M(x, y, z) = | T(x, y, z)|, where 
T(x, y, Z) = {p < x|p is inert in k and o,(p) < C, for some y < q <z}. 
Then, as in [3], we have 
N(x, y) — M(x, y, 2x) S N(x) S N(x, y) 
and by inclusion-exclusion, 
N(x, y) = ¥ u(m)z,,(x) , 


where the summation is over all square-free integers all of whose prime factors are 
< y. If 
ICI 
o'(y) = m) —, 
(vy) => aC iG. 


with the range of summation as above, then using Lemma 5, we get 


N(x, y) = 5'(y) eae + 0(x/log x) , 
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where y is sufficiently small and y = y(x) > 00 asx — oo (e.g. y = (1/6) log x), and 
5(y) + 5(I) as y— oo. If some prime in the range x'/? log x < q < 2x divides 
[E(F,): Ip], then |I',| < 2x*/? log x, so by Lemma 14 of [3], we have 
M(x, x!/? log x, 2x) = O(x/log? x) . 
Let F be a rank 1 subgroup of I’, so that 
M(x, y, z) < M(x, y,z), 
where M(x, y, z) represents the same quantity as above but with I replaced by r. 
By Lemmas 4 and 5, 
M(x, y, x'/*/log x) < =. ((1/q7) li x + O(gx*!? log qx)) = o(x/log x) 
y<q<x'!*/logx 
since y+ 00 as x > 00, so we need only deal with M(x, x'/*/log x, x'/? log x). In 
fact, it suffices to estimate 
M'(x, x'/*/log x, x!/? log x) = |S(x, y) A T(x, x!/*/log x, x!/? log x)| . 
It is convenient to introduce 


M'(x, y; q) = |{peES(x, y)|oq(p) < Cz}| « 


If o,(p) < Cj, then q\CE(F,):T pj, 80 p= — 1 mod gq. We can utilize this to obtain 
an upper bound for M’(x, y; q). In the enumeration of S(x, y) above, one has to 
replace the fields L,,, where all prime divisors of mare < y, with the compositum of 
these fields with Q(¢,), and the size of the conjugacy set does not increase. 
Moreover, for q sufficiently large, the field L,, and hence Q(C,), is disjoint from all 
these L,,. This leads to 


M'(x, yg) SOF lx + O(8" log ax), 


for q sufficiently large, and using the fact that 


1 
or log log(x!/?/log? x) — log log(x'/*/log x) ~ log2 , 


x/4/logx <q < x!/2/log?x 4 — 


we obtain the estimate 
M(x, x'/*/log x, x!/?/log x) < (1 — log 2 — «)6'(I) lix 


for x sufficiently large. To handle the remaining interval M(x, x'/*/log? x, 
x'/? log x), we use the Brun-Titchmarsh theorem (see [4]). Since if q|[E(F,):I',] 
then p = 1 mod q, we have 
x 
2 ag TOBA)” 
x1/2/log?x <q <x'/2logx 7 og(x/q) 


which is easily seen to be o(x/log x). This completes the proof of Theorem 2. 


M(x, x'/?/log? x, x'/? log x) < 


Proof of Theorem 3. The proof is very similar to that given above, so we give only a 
sketch. One does an initial sieve as before and obtains a bound 


M(x, y, x’/*/log x) = o(x/log x) , 
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and since r(I’) = 6, Lemma 14 of [3] yields 
M(x, x'/* log x) = o(x/log x) . 


The remaining interval is handled as above using the Brun-Titchmarsh theorem for 
inert primes and a generalization of it to number fields for primes which split in k, 
as in [3]. 


5. Generation of E(F,) in the non-CM case 


We now suppose that E does not have CM, and ask how often E(F,) =T,. If 
PX gA, then we have as before that q|[E(F,): I’, ] ifand only ifo,(p) < C,, where C, 
is a conjugacy subset of G, = Gal(L,/Q), and L, = Q(E[q], 41), but in this case, 
the sizes of G, and C, are bigger; we have: 


Lemma 6. We have |G,|=<q?"** and |C,|=q"*?. 


Proof. See [3], p. 35. The difference from Lemma 4 arises from the fact that the 
Galois group of Q(E[q])/Q is almost always GL,(Z/qZ). 


We expect S(I) to have density 6(I), where 6(I) is as in section 4. Because of the 
large size of the conjugacy sets involved and the resulting worsening of the error 
terms in the Chebotarev density theorem, one can only prove this in case r(I’) = 18, 
under the GRH (see [3]). Using the improved error term of [12], one can improve 
this to r() = 11, under the assumption of Artin’s holomorphy conjecture. 

We are able to bring the rank down even further by not insisting on producing a 
set of density 5(I°) but rather a positive multiple of it, as we did in section 3. 


Proof of Theorem 4. We will use the same notation as in the proof of Theorem 2. 
For r(I’) = 7, we are able to handle M(x, x?/°**, 2x) using Lemma 14 of [3], and 
after doing an initial sieve as before, are left with having to estimate M(x, y, x?/9**), 
where y > © asx — 0. We instead estimate M(x, y, x!/4**), corresponding to a 
rank-one subgroup I of I’. Using Proposition 2, one can show under the GRH that 


M(x, y, x!/9-*) = o(x/log x) , 


since the size of the conjugacy class involved is=q* by Lemma 6, and hence the 
error terms are essentially O(q*x'/*). One must use the fact, which is proved as in 
[3, Lemma 7], that dy < [L,,:Q]log n. Under the additional assumption of Artin’s 
holomorphy conjecture, one can show using Proposition 2 that 


M(x, y, x!/°~*) = o(x/log x) . 


To estimate the remaining portion of the tail, we impose the condition 
q\LE(F,):F, J into the initial sieve. Letting m be a square-free integer all of whose 
prime factors are < y, we proceed to estimate the number of primes p for which 
Om(P) < C,, and q|[E(F,): r J. Let F, be the (non-Galois) extension of Q of degree 
q’ obtained by adjoining to Q some value of } X, where X is a generator of I’. From 
[3], p has q first degree primes above it in F, or splits completely in Q(E[q]). The 
latter condition has the effect of introducing essentially q* (the degree of Q(E[q]) 
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over Q) into the denominator of the main term and only a factor of log q into the 
error term. Also, applying Proposition 2 to the Galois extension F,L,,/F,, with the 
conjugacy set C* which is the extension of C,,, we get the following estimate for the 
number of first-degree primes of F, with norm < x and whose Frobenius symbol 
lies in C*: 


. 
a lix + O(|C,,|q?x*/? log mqx) . 
Here we have used the estimates 

d,,, < [Ly:Q]log m, dp, < [F,:Q]log q , 


which can be easily proved as in [3] because of the limited ramification in these 
fields. Using the same notation as before, we conclude that 


1 itn a 
M(x, x%, x?/9**) < 5(L) ? (E+ Zc)ux4 O(\C,,|qx?/? log mqx) . 
x< q < x2/ore q q ‘ 


Choosing y sufficiently small but still tending to 00 (e.g. y = c loglog x), and using 


1 2/9 +6 
— log a OE 
xX7<q < x2/9te q a 


> 


with a = 1/10 — « or 1/6 — «, we obtain the desired result. 


6. Concluding remarks 


If E is an elliptic curve over a number field K, then one can still ask the question of 
how often E(F,,) is cyclic where v is a prime ideal of K. The method of proof of 
Theorem 1 requires a corresponding sieve result. More precisely, we need to know 
that primes that split completely in K are well-distributed in arithmetic progres- 
sions. If K is an abelian extension of Q, this amounts to putting additional 
congruence conditions on the primes so that the theorem of Fouvry and Iwaniec of 
sieve theory can be employed without alteration. Hence, if K is abelian over Q, then 
there are at least > x/log? x prime ideals v of K such that Norm(v) < x and E(F,) 
is cyclic, provided E[q]¢ E(K) for any prime g. However, if K is not abelian over 
Q, one would have to introduce non-abelian conditions into the sieve theorem of 
Fouvry and Iwaniec. This has been done for the classical theorem of Bombieri and 
Vinogradov (see [11]). But this would only produce primes p of the desired type 
such that all the odd prime factors of p — 1 are > p’/*~*. This is not sufficient for 
our needs since the fact that the exponent is > 1/4 was crucial to our argument. 
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